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EQUIPMENT AND METHODS FOR THE DISPLAY OF HIGH 
RESOLUTION IMAGES USING MULTIPLE PROJECTION DISPLAYS 

CROSS-REFERENCE TO RELATED APPLICATION 

[0001] This application claims priority to U.S. Provisional Patent Application No. 
60/586,177 filed July 8, 2004 entitled "Equipment and Methods for the Display <f 
High Resolution Images Using Multiple Projection Displays" the contents of which 
are incorporated herein in their entirety by this reference. 

FIELD OF THE INVENTION 

[0002] This invention relates to projection of images and more specifically to 
techniques and equipment for creating high resolution images by tiling together 
multiple projection displays. 

BACKGROUND OF THE INVENTION 

[0003] Spatial Light Modulator (SLM) based projection displays are often used in 
applications where the spatial resolution of a single projection display system of a 
given type is inadequate. Projection displays may also be required where the 
projection surface covers a large area or a surface of a shape that cannot be covered 
by a single projection display system with the desired brightness and image quality. 
[0004] In such situations it is common to employ multiple projection displays in a 
tiled arrangement. Two or more projection displays are arranged so that their images 
are adjacent and form a matrix of horizontal and vertical elements so that the resulting 
composite image has a higher resolution and brightness than would result if a single 
projection display were used to cover the same projection surface area. Subdivision 
of the display also allows the projection surface to change in shape or distance from 
the projection points without requiring excessive depth of focus or special distortion 
correction from the projection lenses. It is frequently desired that the image formed 
by multiple -projection-displays -should -appear-to- the viewer, as-if-a.single projector-, 
produced it This requires that the seams between each of the multiple images should 
be undetectable, and it also requires a high degree of uniformity for each display and 
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the closest possible matching of characteristics such as the brightness, uniformity and 
resolution of the multiple projection displays. 

[0005] When projection displays are tiled together the adjacent images may be 
butted together or overlapped and blended Both electronic and optical methods have 
been employed for blending two or more images in the overlap region. The electronic 
methods, exemplified by U.S. Patent No. 4,974,073 to Inova, rely on electronically 
processing the image video signal prior to the SLM to impose a smooth adjustable 
reduction in brightness of each display in the overlap region so that the resulting 
brightness of the blended images is uniform. This method has the defect that in the 
overlap region the black levels of the two displays are added together. It is inevitable 
when using SLM based projection displays that a finite amount of light will reach the 
projection screen when these displays are driven with a full black image video signal. 
This full black image video signal is the minimum level that can be supplied to the 
SLM, and so the electronic processing method of ramping image brightness in the 
overlap region cannot eliminate the increased black level in the overlap region. This 
increased black level is frequently visible when the image video signal for both 
projectors goes to full black as is common for example between the titles and first 
scene of a motion picture. This increased black level calls to the attention of the 
audience the location of the overlap(s) between the multiple sub-images used to create 
the display, making all of the residual artifacts at the overlap location(s) more 
noticeable. 

[0006] The increased black level can be masked by increasing the black level of 
the image video signal on each display except in the overlap region, but this reduces 
the dynamic range of the display. When a digital representation of image brightness 
is used this reduction is typically equal to one bit, a significant loss of dynamic range 
in systems that rely on 8 to 10 bits for the representation of image brightness. 
[0007] Optical methods for blending two or more images in the overlap region are 
exemplified by U.S. Patent No. 6,017,123 to Bleha et al. Bleha places an opaque 
knife edge blending mask in the image light path, either before or after the SLM, or 
after the projection lens, this mask is placed at an edge oflhe image proaSicecTBy ~ 
each projection display where an overlap will occur in the composite projection 
display. The mask is out of focus and as a result produces a gradual reduction of 
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brightness at the edge of the projection image display. Bleha further describes 
improvement to the quality of the brightness reduction in the overlap region by the 
use of neutral density filters to further control the slope of the brightness reduction in 
the overlap region and thereby reduce artifacts due to imperfections in the slope of the 
brightness reduction. 

[0008] International Patent Application PCT/EPOO/1 1910 to Maximus et al. 
describes a soft edge plate or blending mask consisting of an opaque area, a 
transparent area, and a semi-transparent area between the opaque and transparent 
areas that is placed in a location in the projector where its image will be out of focus 
when the projection lens is adjusted to properly focus the image of the projector's 
SLM devices on the screen. The out of focus image of the edge of this soft edge 
blending mask provides a smoothing of the slope of the brightness reduction produced 
by the mask. The effect of this soft edge blending mask is similar to that described in 
Bleha where neutral density filters are used in combination with a knife edge blending 
mask. 

[0009] In an SLM based projection display it is important that the display should 
accurately reproduce the colors and brightness of the input image signal. One feature 
of a SLM based projection display that provides accurate reproduction is high 
uniformity of image brightness and color. As previously mentioned display 
uniformity and the matching of brightness and color is also important when tiling 
such displays. 

[0010] The uniformity of illumination provided to the SLM devices is a major 
factor in determining the brightness uniformity of the projected image. As we will 
later describe, the nature of the illuminating light is also an important factor in the 
uniformity of color, particularly where a color separation and re-combining device 
based on dichroic filters is employed with multiple SLM devices in a color projection 
display. 

[0011] A method for obtaining a uniform source of illumination for the SLM 
devices is to use a light homogenizer to improve the uniformity of the illuminance 
distribution provided by the lamp and reflector commonly employed as the Tight 
source in a SLM based projection display. There are two common forms of light 
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homogenizers, a light pipe or integrating bar, and a micro-lens array homogenize^ 
commonly called a "fly's eye integrator". 

[0012] UK Patent Application GB 2,352,836 to Creek et al. describes a method 
for reducing artifacts due to imperfections in the slope of the brightness reduction 
when projectors employing transmission type LCD devices as the SLM are used with 
an optical blending method. Creek is directed to the problem of illuminance non- 
uniformity due to the nature of the illumination provided to the LCD by a light 
homogenizer utilizing a pair of micro-lens arrays. This type of light homogenizer 
produces at its output many overlapped images of the input illuminance distribution 
equal to the number of micro-lenses in the array. In a fly's eye integrator collimated 
light is focused by the first micro-lens array onto a second micro-lens array. The 
illuminance distribution at the second micro-lens array is necessarily non-uniform to 
ensure efficient operation (each micro-lens in this second array is under-filled with 
light). The illuminance distribution at the second micro-lens array is imaged onto the 
pupil of the projection lens and the angular distribution of light through the projection 
lens is non-uniform. In the most usual case where the projection lens has a telecentric 
entrance pupil, the overall intensity distribution at the modulator plane is also non-* 
uniform. If the intensity distribution for all points in some field after the fly's eye 
integrator is considered, the intensity distribution at each field point is non-uniform 
and this non-uniformity is constant for all field points. 

[0013] When an edge blending mask, which acts on the angular distribution of 
light, is inserted into the illumination path after a fly's eye integrator, the mask will 
clip the contained intensity distributions differently for each field point. This causes 
small variations or ripples in the illuminance ramp produced by the edge blending 
mask. This pattern of ripples is dependent on the intensity distribution but not on the 
field point after the mask where the intensity distribution is evaluated. 
[0014] Creek also describes a method of reducing the ripples across the blending 
region by inserting a diffusing or scattering element between the output of the fly's 
eye homogenizer and the LCD panel. The scattered light makes the intensity 
distribution at each field point on the LCD panel more uniform, reducing tie non- 
uniformities due to intensity distribution dependent clipping by the edge blending 
mask. This system has the limitation that the diffusing or scattering action also 
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reduces the amount of light that subsequently reaches the pupil of the projection lens, 
lowering the brightness of the image. It is also important to understand that the 
ripples described in Creek stem from a globally non-uniform intensity distribution, 
which is constant across all field points at the LCD panel. As is later described, this 
effect and its cause are different from what is found in systems that use a light pipe or 
integrator bar. 

[0015] Additionally, smoothing the brightness of the composite displayed image 
in the overlap region(s) of a tiled display is not sufficient to ensure that the resulting 
composite display has the desired image quality. Each of the smaller projection 
displays used to create the composite image has a non-uniformity that results from 
light fall off over the area of the display, as well as other sources of non-uniformity 
such as variations in the alignment of the optical components in the projector. 
[0016] U.S. Patent No. 5,386,253 to Fielding describes a method for improving 
the uniformity of the displayed image. In Fielding, a sensor observing the far field is 
used to measure the brightness of the projected image and this information used to 
correct the brightness distribution on the screen by modifying the pixel brightness 
values supplied to the SLM. This modification in pixel brightness may be used to 
compensate the brightness of the projected image to achieve any desired brightness 
distribution. The method in Fielding cannot increase the brightness of a given area of 
the screen above that available for that given area in the uncorrected system. As a 
result, modifying the pixel brightness of areas of the projected image to achieve, for 
example, a flat field of uniform brightness will typically limit the brightness of the 
display to that of the least bright area of the projected image. 

[0017] U.S. Patent No. 6,1 15,022 to Mayer III et al. describes a method like that 
in Fielding where adjustment of the pixel values may be used to correct for brightness 
non-uniformity in the displayed image. This method is subject to the same limitations 
as Fielding in that the method cannot increase the brightness of a given area of the 
screen above that available for that given area in the uncorrected system. As a result, 
modifying the pixel brightness of areas of the composite projected image to achieve, 
for example, a flat field of uniform brightness will typically limit the bnghtness"of the 
display to that of the least bright projector being used to create the composite image. 
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[0018] The optimum blending of the images from multiple projectors requires that 
the alignment of adjacent projection display images on the projection screen should be 
exact. This is required to prevent discontinuities of image features such as, for 
example, diagonal lines as they move across the composite display. In addition, the 
resolution of the composite display should be maintained across the overlap region, 
also requiring very precise alignment of the multiple images. Where multiple 
projection displays are used the resolution in the overlap region is typically lower than 
the resolution at the center of the image of each of the individual displays, that is, in 
the non-overlapped regions. This is because of the misalignment between the 
displays in the overlap region and because the overlap region is at the edge of the 
projected image where the residual aberrations of the projection lens reduce the 
sharpness of the projected image. 

[0019] In U.S. Patent No. 5,153,621 to Vogeley a method is described wherein 
two optically butted displays are illuminated by a single light source and their images 
are then projected through a single lens by means of a system of mirrors. This places 
adjacent edges of each display along the optical axis of the projection lens. Vogeley 
teaches that this configuration provides a tiled image of two or more displays with 
minimal illuminance discontinuities at their juncture. Vogeley is primarily concerned 
with making the seam between the optically butted displays invisible by ensuring 
uniformity of illumination at the seam. However, Vogeley does not go on to further 
teach the necessity of precise alignment of the adjacent displays in order to achieve a 
uniform projection display. Furthermore, Vogeley does not recognize the resolution 
improvements provided by placing the adjacent edges of the two display images on 
the optical axis of the projection lens. In addition, Vogeley describes a system that 
does not overlap the adjacent images, and also does not provide a means to mitigate 
the seam or gap between adjacent images. It is inevitable in such a system that a 
finite separation will be perceivable between the adjacent images. 
[0020] When the uniformity of a tiled display is considered purely in terms of 
brightness uniformity and the comparative invisibility of the seams, methods using 
overlapped displays produce results superior to optically butted displays. In Sis 
regard the critical factors are the adjustment of the positioning and slope of the 
brightness ramps in the display if electronic means are used, or the alignment and 
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positioning of the masks if optical means are used to blend the overlapped displays. 
Both of these methods are forgiving of minor alignment errors at the level of 
individual display pixels, which in any case are not well resolved at the periphery of 
the individual display due to the limitations of the projection lens as mentioned above. 
But, if it is desired to achieve consistent resolution across a tiled display, methods 
must be introduced to precisely align the pixels of the adjacent displays and to avoid 
the loss of resolution of the individual displays at the edges where the overlap occurs. 
[0021] The alignment of multiple projection displays in the prior art is 
accomplished by adjusting the physical relationship of each of the projectors so that 
their images fall on the screen in the desired location. Precise adjustment of larger 
SLM based projectors is more difficult due to their size and weight. U.S. Patent No. 
5,847,784 to Finnila et al. discloses a method for aligning multiple optically butted 
displays by moving the SLM devices. This method requires additional components in 
the mounting of the SLM devices and potentially diminishes the image quality and 
stability in the projector. In a color projector using three SLMs for additive color, the 
precise alignment of these devices with respect to each other is generally required for 
image quality. That is, within each individual color projector in a color multiple 
projector display the alignment of each projector's three SLMs with respect to each 
other is critical for image quality. In addition modem SLM projectors subject the 
SLM devices to substantial luminous flux, resulting in significant heating of the 
devices and the associated colored image combining optics. The requirements of 
thermal stability conflict with the requirements of a mechanism to permit position 
adjustment of the individual SLM devices. 

[0022] Finnila places the quality of alignment of the tiled image ahead of the 
quality of alignment of the color planes; this is exemplified by figure 5 of the Finnila 
patent where separate projection lenses are used for each of the three colors. As a 
result color alignment must be accomplished at the screen and will likely not achieve 
the same tolerances or uniformity as that provided by the alignment of the tiled pairs 
of SLMs in each color channel. 

[0023] An alternative to moving the SLM devicerihemielves inlheprior artislo" 
move the displayed image on the SLM pixel matrix. However, this has two important 
disadvantages. First, position adjustments are limited to one pixel increments; 
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making it unlikely that pixel for pixel alignment will be achieved between two 
adjacent displays. Second, a border of unused display pixels must be established on 
all sides of each SLM so that the image may be moved on the SLM pixel matrix 
without being cropped. 

[0024] If the projectors used in the multiple projection display were of a scan type 
display such as a CRT or laser based projector the scanning system might permit the 
sub-pixel adjustment of the image position within the scan area of the device. A 
system of this type is described in U.S. Patent No. 6,193,375 to Nagata et al. This 
patent discloses a method for aligning optically butted scanned laser displays by 
adjusting the position of the scan patch of each display. However, the techniques 
disclosed in Nagata are not suitable for use with SLM devices, and the patent does not 
teach an embodiment suitable for use in an additive color display. 
[0025] The prior art has not provided a solution that completely solves the 
problems of uniformity and other artifacts in the overlap region of tiled projection 
displays. Problems with the resolution of the image in the overlap region between 
adjacent displays have not been addressed due to limited resolution at the edges of 
typical projection displays. 

[0026] As a result the performance of tiled multiple projection displays is less 
than satisfactory due to artifacts in the seam region, non-uniformity of the individual 
displays and poor alignment between the various projection displays. 

SUMMARY OF THE INVENTION 

[0027] The present invention seeks to resolve these issues of artifacts, uniformity 
and resolution by introducing equipment and methods that allow the improved tiling 
of multiple projection displays to create a higher resolution composite image. 
Equipment and methods are disclosed for improved blending of the seam by 
smoothing the intensity distribution of the illumination system and by special 
placement of edge blending masks for producing the brightness ramp in the overlap 
region. ^Equipment and methods are also disclosed for the correction of artifacts in an 
optically blended seam by modifying the brightness of image pixels in the overlap or 
blend region. Equipment, systems, and methods are disclosed for preserving the 
resolution and uniformity of the image across each seam by actively controlling the 
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position of each display using a servo controlled lens mount for the positioning of 
each projected image in conjunction with a real time image analysis system. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] These and other features, aspects, and advantages of the present invention 
are better understood when the following Detailed Description is read with reference 
to the accompanying drawings. 

[0029] Figure 1 illustrates a projection system for tiling two projection displays to 
form a composite image according to the prior art 

[0030] Figure 2 illustrates the brightness profiles of the overlap region in the 
system of figure 1. 

[0031] Figure 3 illustrates a source of illumination for a projector in the system of 
figure 1 according to the prior art. 

[0032] Figure 4 illustrates the intensity distribution of the illumination source of 
figure 3. 

[0033] Figure 5 illustrates the illuminance distribution of the illumination source 
of figure 3. 

[0034] Figure 6 illustrates the effect of an integrator bar at a central field point on 
the intensity distribution of the illumination source of figure 3. 
[0035] Figure 7 illustrates a color separating and re-combining device for a 
projector in the system of figure 1 according to the prior art. 

[0036] Figure 8 illustrates the optical configuration of a projector in the system of 
figure 1 according to the prior art. 

[0037] Figure 9 illustrates the relationship between the illuminance distribution 
from the integrator bar and the intensity distribution of the source for the system in 
figure 8 at two field points. 

[0038] Figure 10 illustrates the intensity distribution at the output of the integrator 
bar for the optical configuration of figure 8 at a field point to the right of the center of 
the_optica A axis. 

[0039] Figure 1 1 illustrates the intensity distribution at the output of the integrator 
bar for the optical configuration of figure 8 at the right hand edge of the field. 
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[0040] Figure 12 illustrates the relationship of two overlapped projected images 
where the overlap corresponds to 50% of the total width of each projected image. 
[0041] Figure 13 illustrates the intensity distribution at the integrator bar output 
for the optical configuration of figure 8 with a knife edge blending mask at the output 
of the integrator bar located so as to produce a brightness ramp at the right hand edge 
of the projected image. 

[0042] Figure 14 illustrates the intensity distribution at the integrator bar output 
for the optical configuration of figure 8 with a knife edge blending mask at the output 
of the integrator bar located so as to produce a brightness ramp at the left hand edge 
of the projected image. 

[0043] Figure 15 illustrates the illuminance profiles across the overlap region for 
various amounts of overlap between two projected images. 

[0044] Figure 16 illustrates the intensity distribution at the integrator bar output 
for the optical configuration of figure 8 with misalignment of the lamp. 
[0045] Figure 17 illustrates the illuminance profile across the overlap region for 
an overlap between two projected images of 50% with one projector having a 
misaligned lamp. 

[0046] Figure 18 illustrates an improved arrangement for an edge blending mask 
according to the present invention. 

[0047] Figure 19 illustrates the optical configuration of a projector incorporating a 
diffuser element according to the present invention. 

[0048] Figure 20 illustrates an improved configuration for the integrator bar of the 
optical configuration of figure 8 according to the present invention. 
[0049] Figure 2 1 illustrates the illuminance profiles across the overlap region 
resulting from the improved configuration of figure 20. 

[0050] Figure 22 illustrates an alternative configuration for an edge blending 
mask according to the present invention. 

[0051] Figure 23 illustrates a second alternative configuration for an edge 
blending mask according to the present invention. 

[0052] Figure 24 illustrates the path of three ray bun^esHObrou^i the^optical " 
configuration of figure 8. 
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[0053] Figure 25 illustrates the effect of a knife edge blending mask on three ray 
bundles traced through the optical configuration of figure 8. 

[0054] Figure 26 illustrates the effect of an improved configuration of knife edge 
blending masks on three ray bundles traced through the optical configuration of figure 
8 according to the present invention. 

[0055] Figure 27 illustrates an exemplary projection system for tiling two 
projection displays to form a composite image according to the present invention. 
[0056] Figure 28 illustrates edge blending masks for use with the invention of 
figure 27. 

[0057] Figure 29 is a block diagram of the process of adjustment for the system 
shown in figure 27. 

[0058] Figure 30 illustrates in graphical form the brightness profiles at the various 
steps of the process shown in figure 29. 

[0059] Figure 3 1 illustrates the color artifacts at the mask of the system in figure 
27. 

[0060] Figure 32 is a block diagram of the process of adjustment for the system 

shown in figure 27 so as to eliminate the color artifacts of figure 31. 

[0061] Figure 33 is a graph showing the effect on resolution caused by image 

misalignment between the two projectors of the system in figure 27. 

[0062] Figure 34 illustrates equipment for aligning the two images of the systems 

in figure 27 according to the present invention. 

[0063] Figure 35 illustrates an exemplary projection system for tiling two 
projection displays to form a composite image according to the present invention 
incorporating the equipment of figure 34. 

[0064] Figure 36 illustrates test patterns for use in the alignment of the images of 
the system of figure 34. 

[0065] Figure 37 describes the image signals used in the alignment of images 
using the system of figure 34. 

[0066] Figure 38 describes the alignment of edge blending masks using the 
system of figure 34. 
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DETAILED DESCRIPTION OF THE DRAWINGS 



[0067] In order to improve the clarity of the description the present invention will 
be described using the example of two projectors tiled together to form a composite 
display where the two projected images are arranged horizontally. This is a subset of 
a more complex system that may involve more than two projectors arranged in 
configurations where the composite image is produced from a matrix of images 
arranged horizontally, vertically or both. It should be understood that the inventions 
disclosed herein may be applied to the more complex configurations or other suitable 
configurations. 

[0068] Figure 1 illustrates in schematic form the plan view of a projection system 
for tiling two projection displays to form a seamless composite image according to the 
prior art. In this example the image to be displayed is divided into two halves, a left 
half and a right half, each being of the same height, but each being nearly one half of 
the total width of the final image. The composite image is formed on display screen 
100, which receives the left, and right projected image halves from two projection 
systems, a left hand projector, 115 and a right hand projector 135. The left hand 
projector receives an image input signal corresponding to the left half of the desired 
image plus a small overlap region at the center of the desired image, and the right 
hand projector receives an image input signal corresponding to the right half of the 
desired image plus a small overlap region at the center of the desired image. Each 
projection system is identical except for the location of edge blending masks 103 and 
123 and may be described in detail with reference to the left hand projector, 115, as 
follows. The numbers in parenthesis refer to the corresponding elements of the right 
hand projector, 135, in figure 1. 

[0069] An input video or image data signal 1 14 (134) representing one half of the 
image to be displayed is supplied to input circuit 112 (132) which provides various 
facilities known to those skilled in the art for separation of composite inputs into 
discrete red, green and blue or "RGB" signal components as required by the input 

format,- facilities -to -extract image- frame- timing- information- and- facilities-such -as-- 

contrast control, color balance adjustment, image scaling and other features known to 
those skilled in the art The output of circuit 112 (132) is three discrete signals 111 
(131) corresponding to the three color components RGB of the image and a frame 
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timing signal 113 (133). These signals are supplied to display control and formatting 
circuit 110 (130) which in turn supplies the control signals 109 (129) required by the 
SLM devices 106, 107 and 108 (126, 127 and 128). Each SLM device consists of a 
two dimensional array of modulating elements or pixels, and by means of various 
control signals each pixel modulates the flux of a corresponding part of the light to be 
projected so as to form the desired pattern of pixel brightnesses that correspond to the 
image to be projected. Various types of SLM devices may be employed including 
deformable mirror devices (DMDs), or reflective or transmissive liquid crystal 
devices. 

[0070] Each SLM device corresponds to one of the three color components of the 
image to be displayed, and color separating and re-combining device 105 (125) 
provides the optical components necessary to filter input white light into three spectral 
color bands that correspond to the red, green and blue portions of the visible 
spectrum, this color separated light then illuminates SLM devices 106, 107 and 108 
(126, 127 and 128) with red, green and blue light respectively. The control signals 
109 (129) cause the individual picture elements to be controlled so as to modulate the 
flux of the red, green or blue light falling on the SLM, which in turn is re-combined 
by color separating and re-combining device 105 (125) into a single image of overlaid 
red, green and blue components which is in turn projected by lens 104 (124) onto the 
screen 100. It will be clear to those skilled in the art that figure 1 omits for the sake of 
clarity a number of details of the construction of a projector, including the 
illuminating light source and the details of color separating and re-combining device 
105 (125) which varies in its detailed configuration and components according to the 
type of SLM used. 

[0071] The left hand projector 1 15 in figure 1 produces a projected image 102 on 
the screen 100, which proceeds from the lens 104 as more or less a cone of light as 
shown in figure 1 by the dashed lines connecting 104 to 102. Similarly, right hand 
projector 135 in figure 1 produces a projected image 122 on the screen 100, which 
also proceeds from lens 124 as more or less a cone of light as shown by the dashed 
lines connecting 124 to 122. In order to foltn a composite image, 102 is overlapped 
with 122 by some amount, indicated as 101 in figure 1. In order to prevent this 
overlap from being visible as a bright band at the center of the composite image, some 
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means is required to gradually diminish the brightness of the right hand side of image 
102 as it enters the overlap region 101, and likewise to gradually increase the 
brightness of the left hand side of image 122 as it leaves the overlap region 101. This 
function is performed in the system of figure 1 by adjustable masks 103 and 123. 
Mask 103 is located so as to cause the brightness of the right hand half of the left 
image 102 to gradually diminish to black in the overlap region 101. Similarly, mask 
123 is located so as to cause the brightness of the left hand half of the right image 122 
to gradually increase from black. The form of masks 103 and 123 are knife edge solid 
masks or solid masks combined with filters such as those described in U.S. Patent No. 
6,017,123 to Bleha et al. The masks may be made of metal, or of a transparent 
material such as glass, preferably anti-reflection coated, that has an opaque or 
reflecting metal or dielectric coating applied to a portion of the transparent material to 
form the mask. 

[00721 It will be apparent to those skilled in the art that the masks 103 and 123 
may also be located at other points in the projector such as in the illuminating system 
prior to the SLM devices, or between the SLM devices and the projection lens, both 
being described in Bleha et al. 

[0073J Of course it will be apparent to those skilled in the art that the system of 
Inova (U.S. Patent No. 4,974,073) could also be employed to modify the brightness of 
the right hand edge of input image signal 1 14 and the left hand edge of input image 
signal 134, and similarly the input image signals could be pre-processed to 
incorporate a brightness ramp on the appropriate edge, but both of these methods 
would have the previously described disadvantage of an increased black level in the 
overlap region 101. 

[0074] Figure 2 is a representation of a flat field image projected by the system of 
figure l. The overall screen image is shown at 200 and the overlap region at 201. 
When the system of figure 1 is used it is common for residual artifacts to appear at the 
seam in the form of illuminance variations or bands of changing brightness across the 
blending region and extending over the entire height of the screen from top to bottom. 
The dashed outlines 202 and 203 in the overlap region 201 exemplify these affects." 
Similarly graph 210 in figure 2 shows the ideal brightness profile across the 
horizontal axis of the screen for each of the two projected images at 2 1 1 and 212, and 



14 



WO 2006/014598 PCT/US2005/024292 

the actual brightness profile for each image at 213 and 214. The ideal profiles 211 
and 212 are shown with a linear fall off in the overlap region, but any profile may be 
used so long as the profiles for each image are the same and complimentary in 
brightness across the overlap region. 

[0075] The composite brightness profile for the imagie at 200 is shown in the 
graph at 220. hi each case the horizontal axis of the graph corresponds to the 
horizontal dimension of the representation of the projected image 200, and the vertical 
axis of the graph shows the relative brightness of the projected image on the screen. 
The irregularities in the brightness profiles 213 and 214, exemplified by 215 and 216 
on the graph at 200 and by 221 and 222 on the composite brightness profile 220 in 
figure 2 correspond to the banding artifacts 202 and 203 in the overlap region 201 . 
[0076] When the prior art of optically blending images produced by SLM based 
projectors is practiced, it is also common for a color shift to appear in the blending 
region. This color shift is not as noticeable as the illuminance variations. The color 
shift may also be less visible because the illuminance variations that are also produced 
by the optical blending method are more noticeable, obscuring the color shift. 
[0077] In practice the system of figure 1 suffers from inadequate blending quality 
in the overlap region. Even with the use of neutral density filters and multiple masks 
as described in U.S. Patent No. 6,017,123 to Bleha et al. to reduce the banding in the 
overlap region the overlap region remains detectable in certain kinds of images. It is 
apparent from the prior art that others have failed to fully understand the nature of the 
problem of brightness irregularities in the overlap region of optically blended SLM 
based projectors incorporating an integrator bar and a high brightness illumination 
system based on lamp and reflector combinations. The present invention has 
therefore been developed from a greater understanding of the nature of the 
illuminating light in such systems. Since the irregularities of brightness and the color 
shifts that appear in the overlap region of a tiled projection system where the system 
of figure 1 is used arise from the nature of the light that is used to illuminate the SLM 
device, the prior art commonly used for such illumination will now be described. 
[0078] The light in a high brightness projection system is commonly produced' " 
using a Xenon arc lamp and a reflector. Figure 3 shows the arrangement of the 
components of the lamp and reflector combination. At 301 the lamp is shown with 
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electrodes 302 and 303, and arc chamber 304. The light is produced by lamp 301 
from an arc 305 between the arc chamber ends of electrodes 302 and 303. The arc has 
a long axis between the electrodes, and a short axis perpendicular to the axis between 
the electrodes. The arc is more or less rotationally symmetrical about its long axis. 
[0079] As a consequence, the effectiveness of reflector 306 is maximized by 
positioning the electrode axis of lamp 301 along the optical axis of reflector 306. 
Reflector 306 is commonly a surface of revolution corresponding to some portion of 
an ellipse, and the arc 305 is positioned at the first focus of this ellipse, resulting in 
the collected light being brought to focus at a point corresponding to the second focus 
of the ellipse. 

[0080] However, the axial positioning of the lamp 301 results in the electrodes 
302 and 303 obstructing some of the light that emerges from arc 305 and reflector 
306. This produces an intensity distribution similar to the graph of figure 4, which 
shows on the vertical axis the distribution of intensity from the lamp and reflector 
combination of figure 3 as a function of the tangent of the angle from the optical axis. 
As shown at 401 in figure 4 the intensity drops to near zero along the optical axis as a 
result of the obstruction produced by the electrodes 302 and 303 of the lamp 301 in 
figure 3. Since the system is rotationally symmetrical about the optical axis the 
distribution in both x and y across the field is the same. Accordingly the intensity 
distribution of the lamp and reflector in a high power projection system is not 
uniform. 

[0081] Figure 5 shows the corresponding distribution of illuminance that results 
from the lamp and reflector combination of figure 3. This figure shows a graph of 
illuminance on the vertical axis versus field position across the second focus of the 
reflector 306 in figure 3. As the graph shows at 501 the illuminance reaches a peak at 
the center and falls off gradually towards the edge of the field. Since the system is 
rotationally symmetrical about the optical axis the distribution in both x and y across 
the field is the same. 

[0082] The illuminance distribution of figure 5 resulting from the lamp and 
reflector combination of figure 3 is generally not uniform enough to be used directly 
for the illumination source in an SLM based projector. In general a projected image 
with greater constancy of illuminance is desired. Accordingly it is desirable to 
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employ a means of improving the uniformity of illuminance. This is commonly done 
using a lightpipe or integrator bar which by means of internal reflections folds 
multiple images of the input light upon itself resulting in an output illuminance 
distribution that is substantially more uniform than the input illuminance distribution. 
This bar is usually rectangular in shape to match the aspect ratio of the SLM devices. 
The length of the integrator bar is chosen to ensure that the off axis rays entering the 
bar are reflected between the side walls enough times that the output is sufficiently 
homogenized. This homogenized light is then directed to the SLM devices. In an 
SLM based color projector a color separating and re-combining device is commonly 
employed such as that shown in figure 7 at 701. This device occupies significant 
space, and requires the use of an illumination relay system to focus the light output of 
the integrator bar onto the three SLM devices 702, which are commonly mounted on 
or immediately adjacent to the color separating and re-combining device. The light 
703 input to 701 traces a long path through 701 to SLM device 702 before emerging 
as colored, modulated light 704. This relay system is commonly of a telecentric 
design. A telecentric design results in all field points on the dichroic filters in the 
color separating and re-combining device seeing substantially identical ray angles. In 
a relay with a telecentric image the chief ray angles for all field points are parallel to 
the optical axis, and for a surface that is not perpendicular to the optical axis the 
angles of the chief rays are the same for all of the field points on the surface. This 
improves the uniformity of color across the projected image resulting from the 
dichroic filters in the color separating and re-combining device. 
[0083] Figure 8 shows a plan view of the optical system for a SLM based 
projector incorporating the components described above. The lamp and reflector are 
shown at 801, with the integrator bar shown at 802. The illumination relay is shown 
at 803 and the color separating and re-combining device is shown at 804 along with 
the three SLM devices 805. The projection lens is shown at 806. 
[0084] An important fact about an integrator bar such as 802 is that if the input 
light distribution contains a range of angles, the output distribution will also contain 
the same range of angles. In other words, while the output illuminance distribution 
(flux per unit area) of the integrator bar is substantially uniform, the input intensity 
distribution (flux per solid angle) is still present at the output. By extension, in the 
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case where the input intensity distribution is symmetric about the optical axis, the 
output intensity distribution is identical to the input distribution. However, there is a 
marked difference in the intensity distribution at the output of the integrator bar when 
only a single field point is considered. The intensity distribution from any field point 
on the output of the integrator bar may be shown to the first order to consist of 
multiple images of the illuminance distribution at the input of the integrating bar, 
created by the reflections in the integrator bar, weighted by the intensity distribution 
of the source. There are higher order effects when one considers the slight variation 
in the input intensity distribution as a function of field point on the input of the 
integrating bar due to the finite size of the light source. However these higher order 
effects only yield a slight modification to the intensity distribution within each of the 
multiple images and can be safely neglected. The intensity distribution is shown in 
figure 6, which is a view from a single field point on the opticar axis looking back up 
the integrating bar towards the source. Multiple images of the input illuminance 
distribution from figure 5 are seen as at 601 where the darkest shading represents the 
brightest portion of the illuminance distribution. The multiple images form a grid as 
indicated by the lines 602 and 603. Each cell of the grid contains an image of the 
input illuminance distribution weighted by the input intensity distribution as 
previously illustrated in figure 4. Each cell of the grid corresponds to the solid angle 
subtended by the input of the integrator as viewed at its output from the chosen field 
point. The number of source images is a function of the number of reflections that 
occur within the integrator bar. Lengthening the integrator bar will produce a greater 
number of reflections and will therefore produce a greater number of images of the 
input illuminance distribution. 

[0085] As shown in figure 6, the intensity distribution at the output of the 
integrator bar at each field point is the product of the intensity distribution of the light 
input to the integrator bar and the multiple images of the input illuminance 
distribution. Figure 9 is a representation of this situation in a sectional view with the 
optical axis left to right on the diagram. The lines at 901 represent the multiple 
images of the input illuminance distribution produced by the refTections Tn~the 
integrator bar. The angle 902 formed by the aperture of the illumination system is 
traced to a field point 903 at the center of the resulting illuminance distribution at the 
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output of the integrator bar 904. This same angle is traced at 905 to a field point away 
from the center of the output illuminance distribution, 906. This figure illustrates that 
at each field point the multiple images of the input illuminance distribution shift with 
respect to the input intensity distrbution. fn essence one can think of the multiple 
images of the source illuminance distribution as being continuously phase shifted as a 
given point of reference moves across the output of the integrator bar. In figure 6 this 
phase shift would be seen as being confined within each cell represented by the grid 
lines shown in figure 6. In other words there is a field position dependent shift in the 
position of the image of the input illuminance distribution within each of the multiple 
images found at the output of the integrator bar and this shift results in a change in the 
intensity distribution at the output of the integrator bar as a function of field point. 
[0086] The phase shift of the images within the intensity distribution is further 
illustrated in figures 10 and 11. Figure 10 is a view from a field point on the optical 
axis in the vertical direction and displaced to the right of the optical axis by one fourth 
of the width of the field in the horizontal direction. The multiple images of the input 
illuminance distribution are again seen as at 1001, but these images are shifted to the 
right in each cell compared to those shown in figure 6. Figure 11 is a view from a 
field point on the optical axis in the vertical direction and displaced to extreme right 
edge of the field in the horizontal direction. By comparing the image of the input 
illuminance distribution shown at 1001 in figure 10 to the image of the input 
illuminance distribution shown at 1101 in figure 11, it can be seen that the images 
are shifted even further to the right. 

[0087] As discussed earlier, in order to blend two overlapped images we need to 
produce a gradual fall off in the brightness of one image and a complimentary gradual 
increase in the brightness of the other image across the region where the two images 
overlap. This produces an invisible seam when the two brightness profiles are exactly 
matched This is accomplished by inserting an edge blending mask such as an opaque 
knife edge blending mask in the imaging system, either before or after the SLM 
devices. If we now consider carefully the effect of the phase shift on the intensity 
distribution when a mask is introduced we can understand die cause~ of" die 
illuminance variations or bands that appear in prior art systems of blending using edge 
blending masks. 
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[0088] Figure 12 illustrates the relationship of two overlapped projected images of 
identical width where the overlap corresponds to 50% of the total width of each 
projected image. The left hand projected image 1201 corresponds to 102 in figure 1, 
and the right hand projected image 1202 corresponds to 122 in figure 1. The overlap 
region 1203 corresponds to 101 in figure 1; The point 1204 is 25% of the distance 
across the overlap region from the left hand edge of the overlap region. For the 
purposes of illustration and referring back to figure 8 an opaque knife edge blending 
mask is now introduced into the illumination system of the projector at the output of 
the integrator bar 802. The knife edge is positioned so that it clips the intensity 
distribution of the illuminating system in order to produce a fall off in brightness 
across the image from the start of the overlap region to the edge of the image at the 
other side of the overlap region. For each of the two projectors the mask is introduced 
on opposite sides of the optical axis to produce two complimentary brightness ramps 
across the overlap region. The masks may be made of metal, or of a transparent 
material such as glass, preferably anti-reflection coated, that has an opaque or 
reflecting metal or dielectric coating applied to a portion of the transparent material to 
form the mask. Other methods of constructing a suitable mask will be readily 
apparent to those skilled in the art. 

[0089] Figure 13 shows the corresponding plot of the intensity distribution for the 
left hand projected image 1201 in figure 12 as seen from the field point 1204. The 
solid line 1301 shows the position of the left hand projector edge blending mask for 
the field point 1204. Similarly figure 14 shows the corresponding plot of the intensity 
distribution for the right hand projected image 1202 in figure 12 as seen from the field 
point 1204. The solid line 1401 shows the position of the edge blending mask for the 
field point 1204. The total illuminance at this point in the blending region is then 
found by integrating the intensity over all of the angles to the left of the blending 
mask position as shown in figure 13 for the left hand projector and then adding this to 
the integration of intensities for all of the angles to the right of the blending mask 
position as shown in figure 14 for the right hand projector. Due to the phase shift the 
total flux that will result is not the same as what would result from integrating over 
the entire intensity distribution of either figure. 
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[0090] A similar procedure can be carried out to evaluate the illuminance at every 
field point across the blending region, and the results of this evaluation are shown in 
the graph at 1501 in figure 15. This graph shows the illuminance profile for a flat 
field image as a function of position x across the overlap region W of two projected 
images of identical width where the overlap region W corresponds to 50% of the total 
width of each projected image. 

[0091] Figure 15 also shows at 1502 the illuminance profile for a flat field image 
as a function of position x across the overlap region W of two projected images of 
identical width where the overlap region W corresponds to 10% of the total width of 
each projected image, and at 1503 where the two images are 100% overlapped. 
Detailed analysis shows that the only case where the variations in illuminance as a 
function of position across the blending region are exactly in phase is when the 
blending region is 100% of the image width and the two images are fully overlapped. 
In all other cases the variations in illuminance are out of phase with the worst case 
variation corresponding to an overlap region that is 50% of the total width of each 
projected image. This is the worst case of illuminance variation across the blending 
region because in this case the variations in illuminance as a function of position 
across the blending region for each projector are exactly 180 degrees out of phase. 
[0092] The description above relates to the limitations of brightness uniformity 
for a perfectly aligned system. Figure 16 shows the intensity distribution that results 
when the lamp is misaligned with respect to the integrator bar. Figure 17 shows the 
resulting screen brightness non-uniformity when the image from a projector with a 
misalignment like that of figure 16 is combined with one that is correctly aligned 
using a 50% overlap between the two images. This illustrates how the uniformity 
generally worsens with misalignments in the optical system. 

[0093] Inspection of figure 8 suggests other points in the system where the knife 
edge blending mask might be located, such as at the input or output of the 
illumination relay 803, or near the SLM devices 805, or after the projection lens 806. 
These locations represent planes that are offset from any image plane that is conjugate 
to the screen. However, it remains true that there is still a clipping "of The intensity"* 
distribution that varies as a function of field point in all of these cases. Further more, 
because of the construction of the projector's illumination system it is veiy unlikely 
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that the intensity distributions of any two systems will be well matched and so the 
magnitude of the illuminance variations will likely be greater than those; shown for 
example at 1502 in figure 15. 

[0094] The problem of irregularities in the overlap region can be solved by in 
essence reducing or eliminating the effect of the edge blending mask on the non-* 
uniform intensity distribution of the light in the projection system. This can be done 
by either making the intensity distribution more uniform or by randomizing the 
distribution of images within the intensity profile. 

[0095] The frequency of the illuminance variations or bands in the overlap region 
can be understood to be a function of the number of images of the input illuminance 
distribution produced by the integrator bar. These images are a direct function of the 
number of internal reflections that occur as each ray of input light travels through the 
integrator bar. A longer bar allows each ray to undergo more internal reflections or 
bounces, and therefore a longer integrator bar produces a greater number of images of 
the input illuminance distribution. A greater number of images produces a greater 
number illuminance variations or bands in the overlap region when a knife edge 
blending mask is used, but each of these illuminance variations is correspondingly 
smaller. When each of the illuminance variations is smaller, the magnitude of the 
variation in brightness in the projected image is also reduced. Therefore, increasing 
the number of internal reflections by lengthening the integrator bar will mitigate to 
some degree the visibility of the banding. 

[0096] Likewise, as the horizontal and vertical dimensions or cross section of the 
integrator bar are changed with respect to the length, a bar with a smaller cross section 
compared to its length will produce a greater number of images of the input 
illuminance distribution. The number of multiple images of the input illuminance 
distribution found in each direction, horizontally and vertically, as a seen from any 
field point at the output of the integrator bar, will therefore be a function of the aspect 
ratio of the integrator bar. The smaller dimension of the integrator bar will have a 
correspondingly greater number of multiple source images per unit area compared to 
the greater dimension of the integrator barT AnoSfer way'of'saying 'this is simply' to" 
state that the aspect ratio of the integrator bar is preserved in each of the multiple 
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source images, and when the integrator bar has a rectangular shape the multiple 
source images will have a rectangular shape. 

[0097] As previously described, the shape of the integrator bar is commonly 
rectangular, and the aspect ratio of this rectangle is usually matched to the aspect ratio 
of the SLM devices employed in the projector. Since the number of multiple source 
images is a function of the number of internal reflections that occur in the integrating 
bar, and the number of internal reflections will be greater for the narrow dimension of 
the bar, the amplitude of the illuminance variations produced when a knife edge 
blending mask is introduced will be less when the knife edge crosses the narrow 
dimension as shown in figure 18. At 1801 in figure 18 is a representation of the 
projected image area with a narrow horizontal dimension 1802 with respect to the 
vertical dimension. The integrator bar is oriented in a corresponding orientation with 
the narrow dimension as at 1802 in figure 18. Edge blending mask 1803 is positioned 
to cross the narrow dimension 1802 of the projected image and therefore the narrow 
dimension of the integrator bar in the projector. 

[0098] In motion picture applications it is common for the horizontal dimension 
of the image to be between 1.66 and 2.39 times that of the vertical dimension. In 
SLM based projection displays using a single projector this aspect ratio may be 
achieved either by providing an SLM with the corresponding aspect ratio, or using a 
subset of the area of the SLM, or by using an anamorphic lens to transform the aspect 
ratio of the SLM to the desired aspect ratio when projected onto the screen. 
[0099] When multiple projection displays are tiled together, the aspect ratio of the 
resulting composite image is a function of the aspect ratio of the individual displays, 
the number of displays used, and the amount of overlap between each of the displays. 
For example, in the arrangement of figure 1, where two projectors are tiled together, if 
the aspect ratio of each projector is 1.33:1, and the major dimension of each 
projector's image is horizontal, then the composite image, assuming a 10% overlap 
between the two displays, will have an aspect ratio of 2.394:1. Alternatively, if the 
major dimension of each projector's image is vertical, then with a 10% overlap 
between the two displays, the resulting composite Image~wilThave~ an "aspect "ratio "of 
approximately 1.35:1. As can now be appreciated, depending on the desired aspect 
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ratio of the composite image, it may be an advantage to arrange the major dimensions 
of the SLM devices horizontally or vertically. 

[00100] Returning to the integrator bar, it is also the case that when the major axis 
of the SLM device is arranged horizontally or vertically, then the integrator bar in the 
illuminating system will also have its major dimension arranged horizontally or 
vertically to correspond to the position of the SLM device. As shown in figure 18, by 
selecting the orientation of the individual projection displays so that the knife edge 
1803 traverses the smaller axis 1802 of each projected image 1801, the visibility of 
the banding produced by a knife edge blending mask may be correspondingly reduced 
compared to an arrangement where the knife edge transverses the larger axis of each 
display. 

[00101] In the case where the aspect ratio of the SLM devices used in the projector 
is 2 or more, and the corresponding integrator bar is matched to the aspect ratio of the 
SLM, it is likely that the integrator bar will be overfilled on the narrow axis. This is 
because the illumination source (lamp and reflector) typically possesses radial 
symmetry, while the integrating bar is now quite asymmetrical between the horizontal 
and vertical dimensions, hi the direction of overfilling, a more uniform portion of the 
intensity distribution at the input of the integrating bar is selected. This means that 
along the corresponding axis of each cell of the multiple input illuminance 
distributions as seen at the output of the integrator the illuminance distribution seen is 
more uniform and this reduces the effect of the shift of these multiple images within 
each cell as a field point traverses the integrator bar in a direction parallel to the 
overfilled axis. This will produce a corresponding reduction in the amplitude of the 
illuminance variations that arise when as shown in figure 1 8 a knife edge blending 
mask 1803 is introduced such that it crosses the narrow axis 1802 of the projected 
image 1801. 

[00102] This can be applied to any shape of integrator bar at the expense of 
efficiency by arranging the illuminating system to overfill the input of the integrator 
bar in both directions. 

[00103] Another method of making the intensity distribution more uniform is to 
incorporate a diffusing or scattering element in the illumination system. This is 
shown in an exemplary embodiment in figure 19. The lamp and reflector is shown at 
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1901, and the integrator bar at 1902. The diffuser, 1903 is inserted at the output of the 
integrator bar 1902, prior to the edge blending mask 1904, and the diffused light then 
proceeds to illumination relay 1905. The diffuser alters the intensity distribution at 
the output of the integrator bar by scattering the light rays. The angle of scattering is 
selected to provide the required reduction in brightness irregularities across the 
blending region without causing a significant loss of light due to the increase in the 
overall angular distribution of the light that results from the action of the diffuser. 
Note that the amount of scattering needed decreases with integrator bar length as it is 
a washing out of the images shown in figure 6 that is necessary and the angular extent 
of each image decreases linearly with integrator bar length. Thus, with an integrator 
bar of sufficient length, the loss due to the scattering can typically be kept below 3- 
5%. Figure 19 omits the remainder of the projector's optical system, which would be 
similar to that shown in figure 8. It should be understood that the edge blending mask 
1904 can be located in a number of locations after the integrating bar and diffuser. 
The location shown in figure 19 is an example, and upon consideration of the 
projector's optical system other suitable locations for the edge blending mask will be 
apparent to one skilled in the art. 

[00104] With a conventional integrator bar of uniform rectangular cross section 
matched to the aspect ratio of the SLM device, the multiple images of the input 
illuminance distribution at the integrator bar output shift in a regular manner as a 
function of field point. For all useful partial overlaps of two images projected by such 
a system the introduction of an edge blending mask produces illuminance variations 
or bands in the image due to the fact that for every location in the blending region 
(except for the center of the blending region) the corresponding field points for the 
two images are different, resulting in a phase difference between the shifted images of 
the input illuminance distribution. This phase difference is constant across the 
blending region resulting in a distinct pattern that is often quite visible. Another 
method of reducing the illuminance variations across the blending region is to change 
the way in which the input images shift as a function of field point at the output of the 
integrator. 

[00105] A first method for accomplishing this is shown in figure 20. The lamp and 
reflector is shown at 2001, and the illumination relay at 2004. A first section of solid 
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integrator bar 2002 of rectangular cross section is followed by a second section 
consisting of a plurality of integrators as at 2003, all separated by a minute air gap or 
reflectively coated, with the two sections forming a composite integrator. The smaller 
bars in the second section may each be of any shape, such as a square or triangle, but 
in any case the total cross sectional area of the smaller bars will normally be equal to 
the cross sectional area of the first section integrator bar. The smaller bars serve two 
purposes. The first is to produce more images within the intensity distribution 
without the expense of increasing the integrating bar length. The second is that the 
smaller bars may be designed to result in much more complex overlapping patterns of 
source images. Although a shift of these images will still occur as a function of field 
point the complex pattern eliminates distinct phase relationships between overlapped 
images so that the variations in illuminance that occur when these are clipped and 
integrated are both reduced in magnitude and made more random in nature. The 
smaller bars may also be tapered in various ways in order to further modify the source 
image patterns at the output of the integrator bar, but it is desirable that when the 
tapers of the various smaller bars are added together a numerical aperture (NA) results 
that is matched to the etendue of the SLM devices. It is understood that such a 
scheme is not etendue efficient and in a system that is etendue limited, there will be a 
sacrifice in efficiency that increases as the distinct tapers of the smaller bars become 
more pronounced. It may also be desirable to introduce an overall taper between the 
input and the output ends of the composite integrator in order to adjust the NA of the 
composite integrator to suit the SLM devices being illuminated. It would often be 
desirable to follow the section of smaller bars with another section of solid 
rectangular bar (of either uniform or tapered cross section) to further smooth the 
illuminance distribution prior to the SLM devices. 

[00106] Figure 21 is a graph that shows the illuminance profile across the overlap 
region between two images blended by a knife edge blending mask when a split 
integrator bar similar to that shown in figure 20 is used, hi the case of figure 2 1 a 
length of solid integrator bar with a rectangular cross section was followed by a length 
of integrator bar with the same cross section but^^idSlnlo~tw6""paf^ on the * 
diagonal across the rectangular cross section, and an additional solid integrator bar of 
the same cross section followed this divided section. The first and last portions are k 
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of the total length of the integrator bar, and the middle section is H of the total length 
of the integrator bar or twice as long as the first and last portions. 
[00107] At 2101 in figure 21 the illuminance profile is shown for the blending 
region of the left image, corresponding to 1201 in figure 12, blended with a knife 
edge and where the overlap between the two images is 50% of the width of each 
image. This result corresponds to what would be produced by a typical prior art 
illumination system incorporating an integrating bar such as that shown in figure 8. 
At 2102 the graph shows the illuminance as a function of position horizontally across 
the blending region. At 2103 the graph shows the illuminance as a function of 
position vertically through the center of the blending region. At 2104 the appearance 
of the blending region is illustrated with the grayscale representing an exaggerated 
version of the illuminance variations in the blending region. Similarly at 2105 the 
illuminance profile is shown for the right image, corresponding to 1202 in figure 12. 
The resulting illuminance profile when the two images are overlapped is shown at 
2106. This corresponds to the illuminance profile shown at 1501 in figure 15. Note 
that in the illustration of the grayscale image of the blending region when the two 
images are overlapped the variations in the illuminance profile extend over the entire 
image in the vertical direction, making vertical bands or stripes as previously 
explained in figure 2. 

[00108] At 2107 in figure 21 the illuminance profile is shown for the blending 
region of the left image, corresponding to 1201 in figure 12, blended with a knife 
edge and where the overlap between the two images is 50% of the width of each 
image. This result corresponds to what would be produced by the invention of figure 
20 incorporating an integrating bar composed of three sections with the center section 
divided into two parts along the diagonal of the cross section as described above. At 
2108 the graph shows the illuminance as a function of position horizontally across the 
blending region. At 2109 the graph shows the illuminance as a function of position 
vertically through the center of the blending region. At 2110 the appearance of the 
blending region is illustrated with the grayscale representing an exaggerated version 
of the illuminance in the blending region. Similarly at 2111 the illurhinince profilers" 
shown for the right image, corresponding to 1202 in figure 12. The resulting 
illuminance profile when the two images are overlapped is shown at 2 1 12. Note that 
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in this illustration of the grayscale image of the blending region the variations in the 
illuminance are smaller and composed of more or less random areas, making them 
much more difficult to see. 

[00109] A second method for changing the way in which the input images shift as a 
function of field point at the output of the integrator is to alter the pattern of shift in 
the image. For example, changing the shape of the input section of the integrator bar 
in figure 20 to a round or oval shape and the output section to a single rectangular bar 
with a cross sections matched to the input section would result in a pattern of rings 
rather than rectangular cells. The input image shift in this pattern of cells will not be 
related in a regular way to field position across the overlap region, and so the resulting 
pattern of illuminance variations for two blended images will not contain a pattern 
that will be particularly visible. 

[00110] Another solution to the presence of illuminance variations in the overlap 
region of two optically blended images produced by two SLM based projectors, each 
incorporating an integrator bar, is to change the shape of the edge blending mask so 
that the differences in flux between the two images at each field point in the overlap 
region are reduced. As previously shown in figure 15, these differences result from a 
difference in phase of the field position dependent shift of the multiple images of the 
input illuminance distribution that is found at the output of each integrating bar. As 
also shown in figure 15 this phase difference is a function of the amount of overlap 
between the two images. 

[00111] This can be understood by considering a pair of projectors arranged as 
shown in figure 1 to produce a left hand projected image 102, and a right hand 
projected image 122, with an overlap region 101. By adjusting the position of one of 
the projected images with respect to the other the amount of overlap, 101, can be 
varied from 100%, with the two images exactly on top of each other, to 0%, with the 
two images exactly juxtaposed or side by side. As previously shown in figure 15, the 
phase difference ranges from 0 degrees when the two images are 100% overlapped, to 
180 degrees when the overlap between the two images is reduced to 50%. As the 
overlap is further reduced the phase shift continues t^indr^se "reaching 360 degrees' 
when the images are exactly juxtaposed. Since the system is axially symmetric the 
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effect of phase shifts from 1 80 to 360 degrees corresponds to the effect of phase shifts 
from 180 to 0 degrees. 

[00112] As figure 15 also shows, ripples appear in the light fall-off profile 
produced by each knife edge blending mask. Further consideration of this 
phenomenon, as discussed in figures 13 and 14, shows that these ripples arise because 
the multiple images of the input illuminance distribution shift with respect to the mask 
as a function of field point. In effect this shift results in varying amounts of the area 
occupied by each of the multiple images being cut off by the mask. This shift occurs 
in a systematic way, with the number of multiple images and the amount of shift as a 
function of field point being determined by the configuration of the illumination 
system, including the integrator bar geometry. 

[00113] A method of reducing the ripples in the light fall-off profile produced by 
an edge blending mask is therefore to design the shape of the mask to take into 
account the way in which the multiple images of the input illuminance distribution 
shift as a function of field point. This will make the effect of the mask less dependent 
on the shift of the multiple images of the input illuminance distribution while 
preserving its overall effect on the total illuminance, resulting in an illuminance 
profile across the blending region that will have a gradual fall-off with a reduction in 
the ripples found in the light fall-off profile. This is shown in an exemplary 
embodiment in figure 22. This figure shows at 2201 a portion of the multiple images 
of the input illuminance distribution similar to those shown in figure 6, previously 
described. In figure 22 the lightest shading represents the brightest portion of the 
illuminance distribution. The multiple images form a grid and each cell of the grid 
corresponds to the solid angle subtended by the input of the integrator as viewed at its 
output from the chosen field point. An edge blending mask is shown at 2202, this 
mask corresponds in function to the mask shown at 103 in figure 1 for the left hand 
projector 1 15 in figure 1. The mask is located at the output of the integrator bar of the 
illuminating system for the projector 115, similar to 1904 in figure 19, and omitting 
diffuser 1903. The mask 2202 is shaped so that as the overlap region is traversed 
horizontally towards the right hand side of the figure, the coiTesponding effect of the 
mask is to gradually increase the obscuration of each of the multiple images in a 
constant manner even though each of the multiple images shifts in position with 
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respect to the mask as a function of field point. This results in an illuminance profile 
across the blending region that will have a gradual fall-off with a reduction in the 
ripples found in the light fall-off profile such as those that result from a conventional 
knife edge blending mask. 

[00114] At 2203 in figure 22 a portion of the multiple images of the input 
illuminance distribution is again shown, along with a second mask, 2204. This mask 
corresponds in function to the mask shown at 123 in figure 1 for the right hand 
projector 135 in figure 1 . Mask 2204 is also located at the output of the integrator bar 
of the illuminating system for the projector 135, similar to 1904 in figure 19, and 
omitting diffuser 1903. The mask 2204 is complimentary in shape to the mask shown 
at 2202, and is shaped so that as the overlap region is traversed horizontally towards 
the left hand side of the figure, the corresponding effect of the mask is to gradually 
increase the obscuration of each of the multiple images in a constant manner even 
though each of the multiple images shifts in position with respect to the mask as a 
function of field point. Because both of the masks 2202 and 2204 produce a gradual 
fall-off in the illuminance profile of the corresponding projected images across the 
overlap region with a reduction in the ripples found in the light fall-off profile, the 
appearance of banding in the overlap region is also reduced, improving the quality of 
the blend between the two images and resulting in a composite image with reduced 
banding artifacts and reduced variations in illuminance in the overlap region. 
[00115] As can be appreciated by consideration of figure 22, in order for the 
overlap region to have a uniform and constant level of illumination it is necessary for 
the two edge blending masks to have an exactly complimentary relationship so that 
the combined effect of the two masks is to cover the entire overlap region. As can 
also be understood by consideration of a mask as shown for example at 2202 in figure 
22, the relationship of the pattern to the multiple images of the input illuminance 
distribution may be varied by increasing the depth of the pattern in the horizontal 
direction. In the example shown at 2202 in figure 22 the depth of the pattern has been 
selected to correspond to one occurrence of an image of the input illuminance 
distribution, but this could also be two or more in order to mbdify the effect of the~ 
mask on the reduction of ripples in the light fall-off profile produced by the mask. 
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[00116] Because the quality of the blending achieved in the overlap region depends 
on the illumination profiles across, the blending region for each image being as 
complimentary in slope and as identical in contour as possible, and alternative way of 
producing a complimentary mask for the right hand projector is exemplified in figure 
22 at 2205. Here the edge blending mask 2206 has exactly the same relationship to 
the images of the input illuminance distribution shown at 2205 as the mask 2202 does 
to the images of the illuminance distribution shown at 2201 . 

[00117] Comparison of 2201 and 2215 in figure 22 will reveal that complete 
registration of the patterns of the two masks 2202 and 2206 requires that one 
projected image must be shifted vertically by a distance that corresponds to one half 
cycle of the mask pattern. The two projected images can be kept in registration by 
moving the position of the image on the SLM devices in one of the projectors by the 
same amount in the opposite direction. There will be a corresponding loss of picture 
height, since each projected image will have to be masked (at the top in one case, and 
the bottom in the other) to make a continuous total image, but in a practical system 
there will be many more source images and the pitch of the mask will be finer, 
making the required vertical phase shift small, and therefore making the loss of 
picture height small as well. 

[00118] In other words, if the two masks are to align in a complimentary fashion 
the design of mask 2206 requires that the image from the right hand projector 
(corresponding to 122 in figure 1) be displaced vertically by an amount that allows the 
mask profile of mask 2206 to compliment (or interdigitate with) the profile of the 
mask 2202. 

[00119] It should also be noted that as a field point traverses the overlap region in 
the vertical direction there would be a phase shift effect similar to that seen in the 
horizontal direction. In the case of a knife edge blending mask this does not result in 
any field point dependent changes in flux contribution because the vertical phase shift 
is parallel to the mask edge. However, in the case of the mask suggested above the 
vertical phase shift must be considered, and ripples or variations in the illuminance of 
the screen may appear. As previously described, the" number of multiple " images"of~~ 
the input illuminance distribution found in the vertical direction will be related to the 
aspect ratio of the integrator bar in the illuminating system. If the aspect ratio is such 
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that the vertical dimension of the integrator bar is significantly smaller than the 
horizontal dimension, the vertical dimension of the integrator bar will have a 
correspondingly greater number of multiple source images per unit area. In this case 
any illuminance variation that may occur due to the phase shift will be 
correspondingly smaller, and ripples are less likely to appear. 

[00120] If there is no vertical offset between the two images, as described for the 
masks 2202 and 2204 in figure 22, then no ripples will appear because the multiple 
source images all shift in the same way at each vertical field point for both projected 
images, and so the problem of differing phase that is seen in the horizontal case does 
not arise. 

[00121] The masks of figure 22 may be made of metal, or of a transparent material 
such as glass, preferably anti-reflection coated, that has an opaque or reflecting metal 
or dielectric coating applied to a portion of the transparent material to form the mask. 
Other methods of constructing a suitable mask will be readily apparent to those 
skilled in the ait. 

[00122] This invention is distinct from that of Maximus et al. described earlier 
because here the pattern and location of the mask is chosen with regard to the 
configuration of the illumination system, including the integrator bar geometry, 
whereas in Maximus et al. the pattern is chosen based on its location in the optical 
system so that its image will be projected out of focus onto the projection screen and 
without any diffraction effects. 

[00123] An alternative to shaping each edge blending mask to produce a more 
uniform illumination profile in the blending region can be understood with reference 
to the exemplary embodiment in figure 23. This figure shows at 2301 a 
representation of a portion of the multiple images of the input illuminance distribution 
similar to those shown in figure 6, previously described, from two projectors, 
corresponding to the two projectors 1 15 and 135 in figure I. The two representations 
of the multiple images of the input illuminance distribution are shown overlapped by 
50%. The peak of the illuminance distribution in each of the multiple images of the 
input illuminance distribution found at the output of the ~mtegrator bar~for~ohe~ 
projector is represented by the small circles as at 2302, and the peak of the 
illuminance distribution in each of the multiple images of the input illuminance 
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distribution found at the output of the integrator bar for the other projector is 
represented by the small x symbols as at 2303. An edge blending mask for one of the 
projectors, corresponding for example to the mask 103 for the left hand projector 115 
in figure 1, is represented by the solid line at 2304, and this mask would be located at 
the output of the integrator bar of the illuminating system in the projector 115, similar 
to 1904 in figure 19, and omitting difiuser 1903. 

[00124] It can be seen that the peaks of the two illuminance distributions in the 
overlap region represented by 2301 in figure 23, appear in alternate cells of the 
multiple images of the input illuminance distribution, this corresponds to the case of 
50% overlap of the two projected images, as shown at 1203 in figure 12. Note that if 
the mask is shifted with respect to this illuminance distribution as represented by the 
dashed outline at 2305, the effect of the mask remains the same. Shifting the mask 
also corresponds to moving the field point from which the two illuminance 
distributions are seen. 

[00125] The shape of the mask shown in figure 23 at 2304 is chosen taking into 
account the configuration of the illumination system, including the integrator bar 
geometry, and the phase shift between the multiple images of the input illuminance 
distribution that is found at the output of the integrating bars in the two projectors. 
Other shapes of mask that will accomplish this purpose will be apparent to those 
skilled in the art and these alternative shapes may be employed without departing 
from the spirit of the invention. 

[00126] The masks of figure 23 may be made of metal, or of a transparent material 
such as glass, preferably anti-reflection coated, that has an opaque or reflecting metal 
or dielectric coating applied to a portion of the transparent material to form the mask. 
Other methods of constructing a suitable mask will be readily apparent to those 
skilled in the art. 

[00127] This invention is distinct from that of Maximus et al. described earlier 
because here the pattern and location of the mask is chosen with regard to the overlap 
dependent phase shift and the configuration of the illumination system, including the 
integrator bar geometry, whereas in Maximus et aT. the pattern is chosen basedon its" 
location in the optical system so that its image will be projected out of focus onto the 
projection screen and without any diffraction effects. 



33 



WO 2006/014598 PCTAJS2005/024292 

[00128] The illuminance irregularities in an optical blending configuration may 
therefore be reduced or eliminated by any of these techniques used singly or in 
combination. Other embodiments of these inventions will be apparent to those skilled 
in the art and are encompassed by the spirit of the present invention which is based on 
a greater understanding of the nature of the light in the illumination system for a SLM 
based projector. It should also be understood that these techniques could be applied 
to the overlapping and blending of more than two projected images in any pattern. 
[00129] The effects of a knife edge on the illuminating light in a SLM based 
projector also extend to additional effects on the color of the image in the blending 
region. SLM based color projectors commonly employ a color separating and re- 
combining device using dichroic bandpass filters to separate white light into three 
spectral bands (corresponding to red, green and blue colors) prior to illuminating the 
SLMs and then recombine the modulated light from each of the three SLMs prior to 
the projection lens. These filters have a spectral reflectance and transmittance that is 
a function of the incident angle of the light passing through the filter. In typical color 
separating and re-combining devices the angle of incidence used is other than 0 
degrees. The wavelength shift for a dichroic filter is approximated by the following 
equation: 

X s = -*V» 2 -sin 2 0 

n (l) 



where : 

X s = wavelength resulting from tilt angle 0 

X =the wavelength at zero angle of incidence 

n = the effective refractive index of the dichroic coating stack 

[00130] As equation (1) shows a filter used at non-zero angles of incidence when 
tilted to greater angles of incidence will shift its transmission spectrum towards the 
shorter wavelengths and when tilted to lesser angles of incidence will shift its 
transmission spectrum towards the longer wavelengths. The arrangement of the 
dichroic filters in a color separating and re-combining device for a SLM based 
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projector commonly uses a combination of each filter's selective reflection and 
transmission properties. Color uniformity across the projected image therefore 
requires uniformity in the angles at which light reaches each of the dichroic filters in 
the color separating and re-combining device. 

[00131] Referring back to the discussion of the relationship between the intensity 
and illuminance distributions at the output of the integrator bar, we can see that each 
field point on the dichroic filter still sees a range of angles, even though with 
telecentric imaging of this source that range of angles is substantially the same at 
every field point. This means that on a fine scale each field point on the filter is in 
fact not a uniform color, since rays intersect that point at a range of angles. The 
uniform color actually results from averaging of the color at each field point with 
surrounding field points. 

[00132] Figure 24 shows a ray diagram for a projection system like that in figure 8, 
and incorporating an integrator bar 2401, an illumination relay 2402, a color filter 
2403, a single SLM device 2404 and a projection lens 2405. In this diagram the relay 
and projection lens elements are taken to be ideal elements, shown as vertical lines at 
2406 through 2409. The telecentric stop of the illumination relay is shown at 2410, 
and the stop of the projection lens is shown at 2411. The details of the color 
separating and re-combining device components have been omitted for the sake of 
clarity, and the diagram is shown with only one SLM also for the sake of clarity. The 
ray diagram is also drawn in an unfolded configuration with respect to the SLM, 
which is commonly a reflective device. 

[00133] Three ray bundles are traced through the system. Ray bundle 2412 
represents light from the left most edge of the right hand projector image 2415 
(similar to the image 122 in figure 1) at the edge of the overlap region. Ray bundle 
2413 represents light from a point on the right hand image more central to the overlap 
region, and ray bundle 2414 represents a ray on the right hand side of the overlap 
region. 

[00134] If a knife edge, corresponding to the edge blending mask 123 in figure 1 is 
now inserted into the path of the three ray bundles, varying amounts of the rays from " 
each bundle are vignetted or clipped by the mask as required to produce a gradual 
fall-off of brightness towards the left hand edge of the seam. Figure 25 shows the 
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resulting ray angles for each of the three bundles after clipping by the mask 2501. 
The ray bundle at 2503 corresponds to ray bundle 2412 in figure 24, 2504 
corresponds to ray bundle 2413 in figure 24, and 2505 corresponds to ray bundle 2414 
in figure 24. The color filter is indicated by 2502, and as can be seen from figure 25, 
the range of angles at filter 2502 for each ray bundle is substantially different due to 
the clipping effect of mask 2501. 

[00135] It is now apparent that the effect of the changing ray angles due to the 
clipping of the rays as shown in figure 25 is to cause a color shift across the blending 
region. As predicted by the equation shown earlier, this shift will be towards the blue 
end of the spectrum when the rays with a lesser angle of incidence are clipped, and 
the shift will be towards the red end of the spectrum when the rays with a greater 
angle of incidence are clipped. This will be a gradual and more or less smooth color 
shift across the blending region since the changing effect of the mask in clipping the 
rays is likewise continuous across the blending region. 

[00136] We now present a method for improving uniformity by clipping the light 
symmetrically about the optical axis to reduce color artifacts that occur across the 
overlap region. Figure 26 shows how an alternative configuration of knife edge 
blending masks may be introduced into the system of figure 24. This requires two 
masks, 2602 and 2604. Mask 2602 is introduced between the integrator bar 2601 and 
the illumination relay, 2603. The second mask 2604 is introduced at the output of 
illumination relay 2603. The two masks are arranged so that the effect of mask 2602 
is balanced by mask 2604 to symmetrically clip the intensity distribution of the 
telecentric illuminating light imaged by the illumination relay 2603 onto color filter 
2605. Figure 26 also shows the resulting ray angles at color filter 2605 for each of the 
three bundles after clipping by the masks 2602 and 2604. The ray bundle at 2606 
corresponds to ray bundle 2412 in figure 24, 2607 corresponds to ray bundle 2413 in 
figure 24, and 2608 corresponds to ray bundle 2414 in figure 24. As can be seen from 
figure 26, the range of angles at color filter 2605 for each ray bundle is now 
substantially similar due to the clipping effects of mask 2602 and 2604. 
[00137] While the preceding embodiments of fie present invention reduce ~the~ 
artifacts in the blending region of a display using optical blending means, it is 
possible to further improve the results using another embodiment of the present 
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invention, which may additionally improve the uniformity of the composite display 
such as where the brightness is higher at the center of the image from each of the 
multiple projection displays as indicated at 217 and 218 in figure 2. Figure 27 
illustrates in schematic form a plan view of an exemplary projection system for tiling 
two projection displays to form a composite image according to an embodiment of the 
present invention. In this example, the image to be displayed is divided into two 
halves, a left half and a right half, each being of the same height, but each being one 
half of the total width of the final image. The composite image is formed on display 
screen 2700, which receives the left, and right projected image halves from two 
projection systems, a left hand projector, 2719 and a right hand projector 2739. The 
left hand projector receives an image input signal 2718 corresponding to the left half 
of the desired image plus a small overlap region at the center of the desired image, 
and the right hand projector receives an image input signal 2738 corresponding to the 
right half of the desired image plus a small overlap region at the center of the desired 
image. Each projection system is identical except for the location of edge blending 
masks 2703 and 2723 and may be described in detail with reference to the left hand 
projector, 2719, as follows. The numbers in parenthesis refer to the corresponding 
elements of the right hand projector, 2739, in figure 27. 

[00138] An input video or image data signal 2718 (2738) representing one half of 
the image to be displayed is supplied to input circuit 2717 (2737) which provides 
various facilities known to those skilled in the art for separation of composite inputs 
into discrete red, green and blue or "RGB" signal components as required by the input 
format, facilities to extract image frame timing information and facilities to provide 
features such as contrast control, color balance adjustment, image scaling and other 
features known to those skilled in the art. The output of circuit 2717 (2737) is three 
discrete signals 2715 (2735) corresponding to the three color components RGB of the 
input image and an input image frame timing signal 2716 (2736). 
{00139] The input image color component signals are then processed on a pixel by 
pixel basis to adjust the brightness of a predetermined number of pixels so as to obtain 
a more uniform image on^ither side^Fthe overlaj^region'and to"fiuther~reducFthe " 
visibility of artifacts across the overlap region. This processing is performed by pixel 
brightness modification processors 2712 (2732) in conjunction with pixel brightness 
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modification data 2713 (2733) from pixel brightness modification data memories 
2714 (2734). These memories contain a number of locations corresponding to each of 
the pixel locations of the corresponding SLM that require brightness modification. 
For example, the system may be configured to modify the brightness of the image in 
only the overlap region, in which case memories 2714 (2734) contain sufficient pixel 
brightness modification locations to correspond to each pixel in the overlap region of 
the image. Alternatively, the pixel brightness modification memories may contain as 
many locations as there are pixels on each SLM. 

[00140] The pixel brightness modification processors 2712 (2732) adjust the 
brightness value of the input image component signals 2715 (2735) using the 
modification values stored 2713 (2733) in the pixel brightness modification memories 
2714 (2734). Timing information 2716 (2736) is used as required to select the pixels 
to be modified that correspond to the portion of the displayed image that is to be 
modified, and also to determine the address of the appropriate pixel brightness 
modification location in the memories 2714 (2734). Many types of processing may 
be implemented in the pixel brightness modification processors 2712 (2732) known to 
those skilled in the art. For example, the pixel brightness modification memories may 
contain fractional values between 0 and 1 that represent the desired modification of 
brightness for the pixels, and these values may be multiplied by the brightness value 
for each pixel as determined by the input image signal to produce a modified 
brightness value for each pixel. 

[00141] The pixel brightness processors 2712 (2732) each produce an output 271 1 
(2731) which is supplied to display control and formatting circuit 2710 (2730) which 
in turn supplies the control signals 2709 (2729) required by the SLM devices 2706, 
2707 and 2708 (2726, 2727 and 2728). Each . SLM device consists of a two 
dimensional array of modulating elements or pixels, and by means of various control 
signals each pixel modulates the flux of a corresponding part of the light to be 
projected so as to form the desired pattern of pixel intensities that correspond to the 
image to be projected. Various types of SLM devices may be employed including 
deformable mirror devices (DMDs), or reflective or transmissi ve ~ fiquTd" crystal" 
devices. 
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[00142] Each SLM device corresponds to one of the three color components of the 
image to be displayed, and color separating and re-combining device 2705 (2725) 
provides the optical components necessary to filter input white light into three spectral 
color bands that correspond to the red, green and blue portions of the visible 
spectrum, this color separated light then illuminates SLM devices 27(36, 2707 and 
2708 (2726, 2727 and 2728) with red, green and blue light respectively. The control 
signals 2709 (2729) cause the individual picture elements to be controlled so as to 
modulate the flux of the red, green or blue light falling on the SLM, which in turn is 
re-combined by color separating and re-combining device 2705 (2725) into a single 
image of overlaid red, green and blue components which is in turn projected by lens 
2704 (2724) onto the screen 2700. It will be obvious to those skilled in the art that 
figure 27 omits for the sake of clarity a number of details of the construction of a 
projector, including the illuminating light source and the details of color separating 
and re-combining device 2705 (2725) which varies in its detailed configuration and 
components according to the type of SLM used. 

[00143] The left hand projector 2719 in figure 27 produces a projected image 2702 
on the screen 2700, which proceeds from the lens 2704 as more or less a cone of light 
as shown in figure 27 by the dashed lines connecting 2704 to 2702. Similarly, right 
hand projector 27259 in figure 27 produces a projected image 2722 on the screen 

2700, which also proceeds from lens 2724 as more or less a cone of light as shown by 
the dashed lines connecting 2724 to 2722. In order to form a composite image, 2702 
is overlapped with 2722 by some amount, indicated as 2701 in figure 27. In order to 
prevent this overlap from being visible as a bright band at the center of the composite 
image, adjustable masks 2703, 2723 are used to gradually diminish the brightness of 
the right hand side of image 2702 as it enters the overlap region 2701, and likewise to 
gradually increase the brightness of the left hand side of image 2722 as it leaves the 
overlap region 2701. Mask 2703 is located so as to cause the brightness of the right 
hand half of the left image 2702 to gradually diminish to black in the overlap region 

2701. Similarly, mask 2723 is located so as to cause the brightness of the left hand 
half of the right image 2722 to gradually increase from black. The form of masks 
2703 and 2723 may be knife edges as in figure 1 or they may be serrated edge 
blending masks as shown in figure 28 and described in co-pending application United 
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States Application No. 10/312,069, which is hereby incorporated in its entirety by 
this reference. Two masks with complimentary patterns exemplified by 2800 and 
2801 in figure 28 may be used with projectors 2719 and 2739 respectively. This 
configuration of mask has the benefit of further reducing the visibility of the overlap 
region by breaking the overlap region into a series of diagonal elements. This makes 
the brightness irregularities described in figure 2 less visible. 

[00144] The brightness irregularities described in figure 2 are reduced using the 
procedure shown in figure 29. First, the projected images from projectors 2719 and 
2739 as shown in figure 27 are aligned onto the screen 2700 in step 2910 using 
suitable test patterns. Each of the pixel modification memory locations in each 
projector is initially set to leave the corresponding pixel locations unchanged. The 
brightness of each projected image is balanced with respect to the other using the 
center of each projected image as a reference. Color balance is also adjusted so that 
the two projected images are matched in color. The masks 2703 and 2723 are then 
adjusted in step 2912 to produce the desired blend 2701 between the two images. 
Next at step 2914, a full white input signal is supplied to projectors 2719 and 2739 so 
that all pixels of each SLM in each projector are driven to full brightness. Next at 
step 2916 the output of the right hand projector 2739 is blocked and the luminance of 
the image from projector 2719 is measured at a number of locations on the screen 
corresponding to the area of the screen where the pixel brightness may be modified by 
the pixel brightness modification memory locations in the projector. Similarly at step 
2918 the output of left hand projector 2719 is blocked and the luminance of the image 
from projector 2739 is measured at a number of locations on the screen corresponding 
to the area of the screen where the pixel brightness may be modified by the pixel 
brightness modification memory locations in the projector. It should be understood 
that while it is possible to measure the luminance of the image for every pixel on the 
screen in the area where the pixel brightness may be modified by the pixel brightness 
modification memory locations in the projector, this is not a requirement. The screen 
luminance may instead be measured at representative points in the area of the screen 
where the pixel brightness may be modified by the pixellirightness* modification 
memory locations in the projector and then values for all of the pixel brightness 
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modification memory locations may be computed using interpolation methods such as 
linear interpolation or curve fitting methods such as a cubic spline. 
[00145] The screen luminance measurements result in a brightness map for the 
image produced by each projector in the pixel brightness modification region of the 
image. This is then compared with the desired brightness profile in step 2920. The 
desired brightness profile is determined according to the required uniformity of the 
composite display, and may be different for different display applications. Viewing 
distance and display brightness will also play a role in determining the required 
uniformity. Large displays in close proximity to the viewer require uniformity over a 
smaller area than large displays viewed from a greater distance. When viewing 
distances are greater the center to edge uniformity can be more important than smaller 
areas such as the overlap region. Similarly, very bright displays can tolerate greater 
absolute brightness non-uniformities since the viewer will be less sensitive to 
brightness differences when overall display brightness is high. 
[00146] In general the uniformity should be high in the overlap area at the center of 
the screen, while a gradual fall off to the outer edges is acceptable since this is a 
normal characteristic of projection displays. Accepting this gradual fall off is also a 
consideration for overall brightness since smoothing out these overall variations will 
generally result in a reduction in overall brightness. 

[00147] The difference between the measured profile and the desired profile is then 
used in step 2922 to compute a set of brightness modification data values for the pixel 
brightness modification memory locations. 

[00148] In the case where pixel brightness modification is provided in each 
projector only for the overlap region, other facilities in the projector can be used to 
ensure an overall brightness match between the two images prior to measuring the 
brightness in the overlap region. If this is not done, then the initial transition into the 
overlap region of one projector or the other can exhibit a "step" in brightness to bring 
the overall brightness of the brighter projector into range at the start of the overlap 
region. Alternatively, a sloped overall brightness profile could be convolved with the 
ideal brightness profile. 

[00149] In the case where pixel brightness modification is provided for the entire 
area of each projected image, an improvement in the blending of the images may be 
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obtained by using pixel brightness modification to make the brightness profile of each 
projector more uniform. Preferably each projector is adjusted for maximum 
brightness in step 2910. The brightness profile comparison of step 2920 will then 
result in pixel modification values that include reduction of the brightness of the 
brighter image so that the brightness profile across the entire screen is uniform. 
Figure 30 shows a graphic representation of the brightness profile at various steps in 
the process of figure 29 using the system of figure 27. The graph at 3000 in figure 30 
shows a measured brightness profile such as is found across the projection screen 
2700 in figure 27, for each of the two projected images, 3002 for the left hand 
projector, and 3003 for the right hand projector. The horizontal axis of the graph 
corresponds to the horizontal dimension of the projected image and the vertical axis 
of the graph shows the relative brightness of the projected image on the screen. The 
overlap region is indicated at 3001 on the graph 3000. Note that in graph 3000 the 
peak of brightness profile 3002 is higher than the peak of brightness profile 3003 
corresponding to a greater light output from the left hand projector. As discussed 
above both projectors are set for maximum light output. 

[00150] A desired brightness profile is shown in the graph 3010. The profile, 301 1 
is for use with a system of figure 3 that provides for correction of pixel intensities 
over the full image area of each SLM. An ideal fall off profile for each projector in 
the overlap region is also shown at 3012 for the left hand projector and at 3013 for the 
right hand projector. The ideal profiles 3012 and 3013 are shown with a linear fall off 
in the overlap region, but any profile may be used so long as the profiles for each 
image are the same and complimentary in brightness across the overlap region. 
[00151] The desired brightness profile 3011 also takes into account the fall off at 
the edge of the screen, 3014 and 3015 in the graph 3000, which is preserved by this 
version of the brightness profile. The curve at 3020 in figure 30 shows the profile of 
the pixel brightness modification values that are stored in the pixel brightness 
modification memory of the left hand projector in order to correct the profile 3002 to 
match the desired profile 301 1 . The values represented by this curve range from 0 to 
1.0. Area 3021 on curve 3020 is a flat region with a valueof 1.0, " wEclfTs" typical of" 
areas not requiring correction such as the fall off at the outside left edge of the screen. 
The downward curved region at 3022 corrects for the extra light output of the left 
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hand projector. Similarly, the curve 3030 shows the profile of the brightness 
modification values that must be stored in the pixel brightness modification memory 
of the right hand projector in order to correct the profile 3003 to match the desired 
profile 3011. 

[00152] It should be understood that the illustrations of figure 30 apply to one set 
of measurements made horizontally across the screen corresponding to 2700 in figure 
27. It may suffice in some cases to make a single measurement across the screen 
using the methods of figure 29 and compute pixel modification values for all rows of 
the pixel brightness modification memory that correspond to the rows of the image in 
the vertical direction in the area where the pixel brightness may be modified by the 
pixel brightness modification memory locations in the projector. In other cases it may 
be desirable to perform the process of figure 29 for many or all rows of the image in 
the vertical direction in the area where the pixel brightness may be modified by the 
pixel brightness modification memory locations in the projector. 
[00153] Although the system of figure 27 and the process of figure 29 produce a 
significant improvement in the uniformity of the brightness profile across the seam, 
the color shift produced by the effect of the edge blending mask on the intensity 
distribution as previously shown in figure 25 remains. These are shown in figure 3 1 
and take the form of small areas of color shift that appear to be related to the teeth of 
the serrated edge blending mask such as that shown in figure 28. Figure 31 is a 
representation of a flat field neutral gray image projected by the system of figure 27. 
The overall screen image is shown at 3100 and the overlap region at 3101. The 
overlap region contains a series of approximately elliptical areas at 3101, which are 
alternately red colored at 3102 and blue colored at 3103. As described earlier, these 
colored areas result from the effect of the mask on the intensity distribution of the 
projector. When the mask is introduced the different areas of the overlap region are 
composed of different angular distributions of light which results in variations of 
color due to angle variations at each of the dichroic filters in the projector's color 
separating and re-combining device. In a system with a straight edge blending mask 
the brightness discontinuities in the overlap region, also due to the effect of the mask, 
dominate, making the color variations less visible. When the serrated edge blending 
mask like that of figure 28 is used the brightness discontinuities become less 
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noticeable due to the psycho-physical effect of the diagonal features of the mask, 
allowing the color variations to be more readily perceived. 

[00154] It may also be that these areas arise in part from the different paths of rays 
traced by the red, green and blue components of the projected image, which due to 
dispersion in the optical system travel different paths in the near field of the lens, that 
is at the location of the mask, in order to converge at the same points on the screen. 
[00155] The modified correction procedure of figure 32 reduces these artifacts. 
First, the projected images from projectors 2719 and 2739 in figure 27 are aligned 
onto the screen 2700 in step 3210 using suitable test patterns. Each of the pixel 
brightness modification memory locations in each projector is initially set to leave the 
corresponding pixel locations unchanged. The brightness of each projected image is 
balanced with respect to the other using the center of each projected image as a 
reference. Color balance is also adjusted so that the two projected images are 
matched in color. The serrated edge blending masks 2703 and 2723 are then adjusted 
in step 3212 to produce the desired blend 2701 between the two images. Next at step 
3214, a full red input signal is supplied to projectors 2719 and 2739 so that all pixels 
of the red image SLM in each projector are driven to full brightness. Next at step 
3216, the output of the right hand projector 2739 is blocked and the luminance of the 
image from projector 2719 is measured at a number of locations on the screen 
corresponding to the area of the screen where the pixel brightness may be modified by 
the pixel brightness modification memory locations in the projector. Similarly at step 
3218 the output of left hand projector 2719 is blocked and the luminance of the image 
from projector 2739 is measured at a number of locations on the screen corresponding 
to the area of the screen where the pixel brightness may be modified by the pixel 
brightness modification memory locations in the projector. 

[00156] This produces a brightness map for the red color image produced by each 
projector in the brightness correction region of the image. This is then compared with 
the desired brightness profile in step 3220. The difference between the measured 
profile and the desired profile is then used in step 3222 to compute a set of brightness 
modification values for the red pixei brightness modification memory locations. This ~~ 
process is then repeated as indicated at 3224, using a full green input signal supplied 
to projectors 2719 and 2739 so that all pixels of the green image SLM in each 
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projector are driven to foil brightness and a foil blue input signal supplied to 
projectors 2719 and 2739 so that all pixels of the blue image SLM in each projector 
are driven to foil brightness. It should be understood that while it is possible to 
measure the luminance of the image for each color for every pixel on the screen in the 
area where the pixel brightness may be modified by the pixel brightness modification 
memory locations in the projector, this is not a requirement. The screen luminance 
may instead be measured for each color at representative points in the area of the 
screen where the pixel brightness may be modified by the pixel brightness 
modification memory locations in the projector and then values for all of the pixel 
brightness modification memory locations may be computed for each color using 
interpolation methods such as linear interpolation or curve fitting methods such as a 
cubic spline. 

[00157] As in the procedure of figure 29, in the case where pixel brightness 
modification is provided in each projector only for the overlap region other facilities 
in the projector can be used to ensure an overall brightness match between the two 
images prior to measuring the brightness in the overlap region. If this is not done, 
then the initial transition into the overlap region of one projector or the other can 
exhibit a "step" in brightness to bring the overall brightness of the brighter projector 
into range at the start of the overlap region. In the case where pixel brightness 
modification is provided for the entire area of each projected image, an improvement 
in the blending of the images may be obtained by using pixel brightness modification 
to make the illumination profile of each projector more uniform. Preferably each 
projector is adjusted for maximum brightness in step 3210. The brightness profile 
comparison of step 3220 will then result in pixel modification values that include 
reduction of the brightness of the brighter image so that the brightness profile across 
the entire screen is uniform. Similarly, provided that the relative amplitudes of the 
desired brightness profiles for each of the three colors in step 3220 represent the 
desired color balance, the matching of colors between the projectors is accomplished 
by the brightness modification processing in the projector, eliminating the need to use 
other projector facilities to adjust color balance. 
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[00158] The pixel brightness modification process then acts to reduce the visibility 
of the color artifacts described in figure 31, resulting in a more invisible overlap 
region and enhancing the image quality of the tiled projection display of figure 27. 
[00159] A variety of methods may be used to measure the light reflected from the 
screen. These include various types of electronic sensors such as photodiodes or 
video cameras. For this embodiment it is preferable that the measuring device be able 
to accurately measure the selected area of the screen without interference from 
adjacent illuminated areas. In some embodiments it is appropriate to employ 
interpolation techniques between a smaller number of measured points, or use 
measurements of larger areas than pixel resolution and process the measurement data 
further in order to obtain values for comparison to the desired illumination profiles. 
[00160] In the invention described in figure 27 and the procedures of figures 29 
and 32, in the first step of each procedure, 2910 and 3210 respectively, reference is 
made to the alignment of the images from the two projectors, and in the second steps 
2912 and 3212 reference is made to the adjustment of the masks to blend the images. 
In one embodiment a human observer physically manipulates the position of the 
projected image and the location of the masks with respect to the projected beam. 
Proper alignment is critical in order to obtain the best image quality. Images to be 
projected by for example a two projector tiled configuration are supplied to the 
projectors with a certain number of pixels on each horizontal line allowed for the 
overlap region which is expected to be a particular size. In addition, the image in the 
overlap region is composed of varying proportions of pixel intensities from each of 
the two projectors. Misalignment will reduce the resolution of the projected image as 
shown in figure 33. In this figure, the MTF of a pattern of alternating black and white 
lines at the raster pitch of the individual projectors is shown with various amounts of 
misalignment between the two rasters. A misalignment of k pixel reduces the MTF 
to 70% of its value for a single projector. Greater than k pixel alignment errors can 
produce noticeable degradation of finely detailed images in the overlap region, and 
when moving images are projected the passage of fine detail through the overlap 
region will cause noticeable blurring of details. MSalignmenls "of greater than bhe~~ 
pixel will also produce discontinuities in lines and other edges as they cross the 
overlap region. The precise alignment of the two images depends on the image planes 
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of the two projectors being located in the same plane with respect to the projection 
screen. This means that all six degrees of freedom for the orientation of each 
projector's image plane must be aligned with a common reference plane. If the 
projectors are equipped with adjustable magnification lenses then the alignment 
requirement is relaxed by one degree of freedom, that is, along the lens to screen axis 
(z axis) of each projector. 

[00161] One embodiment of the present invention utilizes an improved and 
automatic alignment system for the multiple projected images used to form a 
composite image. Figure 34 illustrates in schematic form an exemplary projector 
providing features for automatic alignment for use in the system of figure 27. The 
system in the exemplary embodiment is simplified for the purposes of illustration and 
provides adjustments for only three of the six degrees of freedom required for perfect 
alignment of the projected images. Figure 34A shows a front view looking into the 
projection lens, and figure 34B shows a side view. 3401 is the outline of the 
enclosure for the projector components. 3402 represents the color separating and re- 
combining device with SLM devices, corresponding to 2705, 2706, 2707 and 2708 in 
figure 27. The image from 3402 is focused onto the projection screen (not shown) via 
projection lens 3403. This lens is provided with a lens magnification adjustment 
mechanism 341 1 that could be operated, for example, by a motor. The mount of lens 
3403 may be translated in the horizontal and vertical direction by a lens position 
adjustment mechanism. For example, the mount of lens 3403 may be translated in the 
horizontal direction by motor 3404 and drive system 3407 and mount of lens 3403 
may be translated in the vertical direction by motor 3405 and drive system 3406. 
[00162] Automation of the image alignment process also requires appropriate 
adjustment of the location of the serrated edge blending mask 3408 so that the gradual 
fall off in brightness of the image begins at the correct location in each projector's 
image area. It is also important that the blending masks of each projector in the 
system of figure 27 are parallel to each other, and this requires rotation of the mask 
with respect to the optical axis. In order to simplify the description the mask rotation 
adjustment has not been shown in figure 34. As previously descnbedlhere are a~~ 
number of suitable locations in the projector's optical system for the edge blending 
masks, such locations generally being chosen so that the edge blending mask will not 
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be in sharp focus when the SLM image is focused on the projection screen. It can 
therefore be appreciated that the position of the mask along the projection axis is also 
important, and that some embodiments of the present invention may include 
additional provisions for adjusting the position of the mask along the optical axis. 
[00163] Serrated edge blending mask 3408 may be translated in the horizontal 
direction by an edge mask position adjustment mechanism, such as, for example, 
motor 3409 and drive system 3410. 

[00164] Controller 3412, which receives position control commands via input 3413 
controls motors 3404, 3405, 3409 and the motor driving the magnification adjustment 
mechanism 341 l. Additional position adjustment mechanisms would be provided to 
adjust the pitch and yaw of the projection lens with respect to the screen and to rotate 
the projected image about the optical axis. All of the required adjustments could be 
accomplished by a suitable 5 degree of freedom kinematic adjustable mount for the 
projector's optical system incorporating, for example, a precision motor drive for each 
of the mount adjustors. 

[00165] Figure 35 shows in partial perspective view an exemplary arrangement of 
two projectors according to the system of figure 27 and containing the adjustment 
mechanisms of figure 34. The projection screen is shown at 3501. The screen 
receives a left hand image 3502 from left hand projector 3503, and a right hand image 

3504 from right hand projector 3505. The two images are overlapped to form the 
overlap region 3508. The central portion of the overlap region 3507 is viewed by 
camera 3506. The image from camera 3506 is received by alignment computer 3509, 
which analyzes the image and sends control signals to the two projectors 3503 and 
3505. Alignment computer 3509 is also provided with an output 3510 that may be 
used to control the selection of alignment images for the two projectors 3503 and 

3505 in conjunction with the image sources for the two projectors. 

[00166] The alignment process may be understood by reference to figures 35, 36 
and 37. In these figures 3601 and 3602 correspond to a pair of one pixel wide lines 
projected in the overlap region 3508 of the screen 3501. The line 3601 would be 
projected by the left hand projector 3503 and located in the image senf to projector" 
3503 so that the line is in the overlap region 3508 in a defined relationship to the 
image projected by the right hand projector 3505 which projects line 3602 also 
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located in a defined location in the overlap region 3508. In figure 36 lines are shown 
as dark lines on a white background, but the responses shown in figure 37 correspond 
to white lines on a dark background. When the portion of the lines in the field of 
view 3507 are imaged by the camera 3506 each scan line from the camera 3506 will 
produce a signal similar to that shown at 3701 where line 3601 corresponds to the 
peak 3702, and line 3602 corresponds to the peak 3703. In this case the two lines are 
more than two pixels apart and the signals 3701 and 3702 are distinct. If the edge 
blending masks incorporated in the projectors are withdrawn so that the overlap 
region is fiiUy illuminated, then the lines 3601 and 3601 can be located so that if the 
projectors are properly aligned they would be one pixel apart within the overlap 
region. The signal from the camera 3506 is analyzed by the alignment computer 
3509, which finds the centroid of each peak and estimates the separation of the two 
peaks. The alignment computer then sends a lens positioning command to one of the 
projectors, for example projector 3505 which moves the lens in the horizontal 
direction so that the line 3602 moves closer to the line 3601. This produces a signal 
similar to that shown at 3704 in figure 37. Again, 3705 shows the response produced 
by the image of line 3601 and 3706 shows the response produced by the image of line 
3602. When the lines are one pixel apart the image on the screen will appear as 
shown at 3603 in figure 36. This corresponds to the signal shown at 3707 in figure 
37. Here the response is a single peak 3710, which is composed of the signals 3708 
and 3709. This indicates that the horizontal alignment of the two images is correct. 
[00167] The vertical alignment of the two images may be accomplished in an 
analogous manner, using horizontal lines projected by the two projectors, and analysis 
of a signal taken from the successive horizontal scan lines of the image received from 
camera 3506. The required analysis is accomplished using image processing 
techniques in the alignment computer 3509. It should be understood that the 
horizontal and vertical lines of figure 36 are for the purposes of illustration only. Any 
two dimensional pattern of suitable size could be analyzed to determine the centroid 
of that pattern and compute the required adjustment of one projected image with 
respect to the other. It should also be understood that in some cases the required" 
alignment of the two projector's image planes to a common reference plane may be 
accomplished by adjusting only one projector, while in other cases the range of 



49 



WO 2006/014598 PCT/US2005/024292 

motions required may be optimized by adjustment of both projectors to determine a 
new common reference plane that makes better use of the adjustment range of the 
projector alignment mechanisms. 

(00168] A further refinement in the alignment is provided by the adjustable 
magnification of the lens 3403 driven by motor 341 1 shown in figure 34. In order for 
the alignment of the image to be correct over the entire overlap region it is preferred 
that the magnification of the two projected images be matched. This can be 
accomplished using the system of figure 35 with a test image such as the one shown at 
3604 in figure 36. This image consists of two vertical lines and two horizontal lines. 
These are arranged in the two images supplied to the two projectors with exactly 
equal horizontal and vertical spacing. The left projector 3503 in figure 35 projects the 
two vertical lines 3605 and 3607. The right hand projector 3505 in figure 35 projects 
the two horizontal lines 3606 and 3608. Image computer 3509 receives the image 
from camera 3506. The centroids for each of the lines in the test pattern are computed 
and the vertical and horizontal separations are compared. If the distance between the 
centroids of the vertical lines does not match the distance between the centroids of the 
horizontal lines then the magnification of one projector is adjusted by the image 
alignment computer 3509 commanding the appropriate projector's controller to adjust 
the magnification of the corresponding lens until the distance between the centroids 
are matched. 

(00169] It should be understood that the horizontal and vertical lines of figure 36 
are for the purposes of illustration only. Any two dimensional pattern of suitable size 
could be analyzed to determine the area of that pattern and compute the required 
magnification adjustment of one projected image with respect to the other. 
[00170] The objective of this alignment process is to achieve at least a l A pixel 
alignment between the images in a multiple projector configuration. This precision 
requires that the image planes of each projector be aligned to a common reference 
plane. It is possible to process the images displayed by the projectors to correct for 
projector to projector alignment errors. This is difficult to do to less than one pixel 
accuracy making such a method typically unsuitable for high resolution applications. 
[00171] The final step in the automated alignment of the projection system in 
figure 35 is the proper positioning of the edge blending mask, shown at 3408 in figure 
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34: This can be accomplished as shown in figure 38. An image is displayed on each 
of the projectors that is black except for the overlap region. A horizontal line from 
such an image is shown in graphical form at 3801 in figure 38. The horizontal 
dimension of each graph corresponds to the horizontal position on the screen while 
the vertical dimension corresponds to the brightness. The image represented by 3801 
results in the illumination profile shown at 3802 being seen by the camera 3506 in 
figure 35. The image is first projected from the left hand projector and the edge 
blending mask is then moved into the projected beam until the illumination profile 
seen by the camera matches the target illumination profile shown in figure 3803. This 
target profile is determined by the width of the blending region and has a brightness 
fall off curve corresponding to the fall off in brightness produced by the edge 
blending mask. The image alignment computer 3509 in figure 35 commands the left 
projector 3503 to adjust the mask as required. Because of the irregularities that are 
expected in the illumination profile with the edge blending mask, a smoothing 
algorithm is applied to the illumination profile seen by the camera in the processing 
performed by alignment computer 3509. The procedure is then repeated for the right 
hand projector. When the mask alignment is completed the pixel brightness 
correction procedures of figure 29 or 32 are then performed. 

[001721 It should be understood that when the system incorporates a provision for 
adjustment of the position of the edge blending mask with respect to the optical axis 
as previously described, the process of comparing the measured brightness fall off 
produced by the edge blending mask to the target illumination profile must be 
performed at a number of points along the blending region, this would be in the 
vertical direction for the system of figure 29. The rotation of the edge blending mask 
with respect to the optical axis would then be adjusted to provide a constant width to 
the blending region over the full screen height. 

[00173] It should be understood that the foregoing is for the purposes of illustration 
only and the principles of this invention can be applied to more than two projectors, 
and to projectors arranged in configurations where the composite image is produced 
from a matrix of images arranged horizontaiiy,~verticaIly ^ both. The~present 
invention is intended to embrace all such alternative configurations, all of which can 
be implemented without departing from the spirit of the present invention. 
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What is claimed is: 

1. A projection system having at least two projectors, each projector 
producing a sub-image, wherein the sub-images are projected on a screen to form 
a composite image and edge portions of the sub-images overlap to form an overlap 
region, each projector comprising: 

a light source for producing light; 

an input circuit for receiving image data signals representing a sub-image 
and separating the image data signals into separate red, green and blue color 
component signals and a frame timing signal, the color component signals having 
pixel brightness data for each pixel of the sub-image; 

a pixel brightness modification data memory for storing pixel brightness 
modification data; 

a pixel brightness modification processor for receiving the color component 
signals, the frame timing signal, and the pixel brightness modification data and 
adjusting the pixel brightness data of the color component signals based on the 
pixel brightness modification data to produce modified color component signals; 

a display control and formatting circuit for receiving the modified color 
component signals and producing control signals based on the modified color 
component signals; 

at least one SLM device for receiving the control signals and modulating 
light received from the light source based on the control signals to produce the 
sub-image; and 

a projection lens for projecting the sub-image. 

2. The system of claini 1, wherein each projector further comprises an 
edge blending mask positioned in the optical path of the sub-image for gradually 
reducing the brightness of the projection of an edge portion of the sub-image. 
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3. The system of claim 2, wherein the edge blending masks are knife 
edge masks or serrated edge masks. 



4. The system of claim 1, wherein the pixel brightness modification 
processor is three separate processors, one for each color channel. 

5. The system of claim 1, wherein the pixel brightness modification 
processor only adjusts the pixel brightness data for pixels of the color component 
signals that are in the overlap region. 

6. The system of claim 1, wherein the pixel brightness modification 
data is a collection of values from 0 to 1 and the modified color component signals 
are produced by multiplying the color component signals by the pixel brightness 
modification data. 

7. The system of claim l, wherein each projector has multiple SLM 
devices, to render the color spectrum, and each projector further comprises a color 
separating and re-combining device associated with the SLM devices. 

8. The system of claim 1, wherein the SLM devices may be 
deformable mirror devices, reflective liquid crystal devices or transmissive liquid 
crystal devices. 

9. The system of claim 1, wherein each projector further comprises an 
integrator positioned between the light source and the SLM device, a diffuser, 
positioned between the integrator and the SLM device, for altering the intensity 
distribution of the light at the output of the integrator, ah illumination relay 
between diffuser and the SLM device and an edge blending mask. 
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10. The system of claim 9, wherein the edge blending mask is 
positioned between the diffuser and illumination relay, between the illumination 
relay and the SLM device, or after the SLM device. 

11. The system of claim 2, wherein each projector further comprises an 
integrator positioned between the light source and the SLM devices, the integrator 
having a first section at the input of the integrator and with a cross section and a 
second section having at least two sub-integrators, and an illumination relay. 

12. The system of claim 11, wherein the sub-integrators are separated 
by an air gap. 

13. The system of claim 1 1, wherein the sub-integrators are reflectively 

coated. 

14. The system of claim 11, wherein the second section has the same 
composite cross section as the cross section of the first section. 

15. The system of claim 11, wherein the sub-integrators are tapered 
toward the outputs of the sub-integrators. 

16. The system of claim 1 1, wherein the integrator is tapered toward the 
output the integrator. 

17. The system of claim 11, wherein the integrator further comprises a 
third section at the output of the integrator, so that the second section is positioned 
between the first section and the third section. 

18 . The system of claim 1 1, wherein the cross section at the input of the 
integrator has a cross section different from the cross section at the output of the 



54 



WO 2006/014598 PCT/US2005/024292 

integrator and wherein the cross sectional area at the input is equal to the cross 
sectional area at the output. 



19. The system of claim 18, wherein the cross section of the input of the 
integrator is circular or oval and the cross section at the output of the integrator is 
rectangular. 

20. The system of claim l, wherein each projector further comprises an 
integrator positioned between the light source and the SLM device, an illumination 
relay between the integrator and the SLM device and an edge blending mask, 
wherein the edges of the edge blending masks are chosen in complimentary 
patterns to take into account an input luminance distribution shift as a function of 
field point for each sub-image. 

21. The system of claim 20, wherein the edge blending mask is 
positioned between the integrator and the illumination relay between the 
illumination relay and the SLM device, or after the SLM device. 

22. The system of claim 1 , wherein each projector further comprises an 
integrator positioned between the light source and the SLM device, an illumination 
relay between the integrator and the SLM device and an edge blending mask, 
wherein a pattern and location for the edge blending mask is chosen with regard to 
an overlap dependant phase shift and configuration of an illumination system of 
the projector. 

23. The system of claim 1, wherein each projector further comprises an 
integrator positioned between the light source and the SLM devices, an 
ijl^jnation^ relay Jbetween the integrator and the SLM devices, a first edge 
blending mask between the integrator and the input of the illumination relay, and a 
second edge blending mask positioned at the output of the illumination relay, 
wherein the first edge blending mask and the second edge blending mask are 
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positioned so that the effect of the first mask is balanced by the second mask to 
symmetrically clip the intensity distribution of the light passing through the 
integrator. 

24. The system of claim 1 further comprising an automatic alignment 
system capable of automatically aligning the sub-images on the screen. 

25. The system of claim 24, wherein the automatic alignment system 
comprises: 

a camera capable of receiving the composite image from the screen; 

an alignment computer capable of analyzing the composite image and 
generating position control signals; 

a controller capable of receiving the position control signals from the 
alignment computer, 

a lens magnification adjustment mechanism associated with each projection 
lens capable of receiving position control signals from the controller and adjusting 
the magnification of the projection lens based on the position control signals; and 

a lens position adjustment mechanism associated with each projection lens 
capable of receiving position control signals from the controller and adjusting the 
position of the projection lens based on the position control signals. 

26. The system of claim 24, wherein each projector further comprises 
an edge blending mask positioned in the optical path of the sub-image for 
gradually reducing the brightness of the projection of an edge portion of the sub- 
image and further comprising an edge blending mask position adjustment 
mechanism associated with each edge blending mask capable receiving position 
control signals from the controller and moving the position of the edge blending 
mask based on the position control signals. 
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27. A method for projecting sub-images oh a screen to form a 
composite image using a projection system with at least two projectors, each 
projector producing a sub-image, comprising: 

storing pixel brightness modification data for each projector in pixel 
brightness modification data memories; 

receiving image data signals representing a sub-image for each projector; 

separating the image data signals into color component signals having pixel 
brightness data; 

adjusting the pixel brightness data using the pixel brightness modification 
data to produce modified color component signals; 

creating control signals from the modified color component signals; 

modulating light using spatial light modulators controlled by the control 
signals to create sub-images; and 

projecting the sub-images on a screen so that the sub-images form a 
composite image and edge portions of the sub-image overlap to form an overlap 
region. 

28. The method of claim 27 further comprising masking an edge portion 
of each sub-image with edge blending masks so that when the sub-images are 
projected on a screen the edge portions of the sub-images create a more blended 
overlap region. 

29. The method of claim 28, wherein the projection system used has a 
first projector and a second projector and the pixel brightness modification data is 
determined by the method comprising: 

aligning the sub-images on the screen; 

adjusting edge blending masks to achieve a desired blended overlap region; 
supplying a full white sub-image to each projector; 

blocking the output of the first projector and measure, at pixel locations of 
the screen corresponding to the number and location pattern of the pixel brightness 
modification memory locations in the second projector, the luminance of the sub- 

57 



WO 2006/014598 PCT/US2005/024292 
image produced by the second projector to create a brightness map for the second 
projector; 

unblocking the output of the first projector, blocking the output of the 
second projector and measure, at every pixel location of the screen corresponding 
to the number and location pattern of the pixel brightness modification memory 
locations in the first projector, the luminance of the sub-image produced by the 
first projector to create a brightness map for the first projector; 

comparing the brightness maps of both projectors with a desired brightness 
profile determined according to the required uniformity of a composite display; 
and 

computing brightness modification data for the pixel brightness 
modification memory locations by determining the difference between the 
brightness maps and the desired brightness profile. 

30. The method of claim 28, wherein the projection system used has a 
first projector and a second projector and the pixel brightness modification data is 
determined by the method comprising: 

aligning the sub-images on the screen, balancing the brightness of each 
sub-image, and balancing the color of the sub-images so that the sub-images are 
matched in color; 

adjusting edge blending masks to achieve a desired blended overlap region; 
supplying a full red sub-image to each projector; 

blocking the output of the first projector and measure, at pixel locations of 
the screen corresponding to the number and location pattern of the pixel brightness 
modification memory locations in the second projector, the luminance of the sub- 
image produced by the second projector to create a red brightness map for the 
second projector; 

unblocking the output of the first projector, blocking the output of the 
second projector and measure, at pixel locations of the screen corresponding to 
the number and location pattern of the pixel brightness modification memory 
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locations in the first projector, the luminance of the sub-image produced by the 
first projector to create a red brightness map for the first projector; 

comparing the red brightness maps of both projectors with a desired 
brightness profile determined according to the required uniformity of a composite 
display; 

computing red brightness modification data for the pixel brightness 
modification memory locations by determining the difference between the red 
brightness maps and the desired brightness profile; 

supplying a full green sub-image to each projector, 

blocking the output of the first projector and measure, at pixel locations of 
the screen corresponding to the number and location pattern of the pixel brightness 
modification memory locations in the second projector, the luminance of the sub- 
image produced by the second projector to create a green brightness map for the 
second projector; 

unblocking the output of the first projector, blocking the output of the 
second projector and measure, at pixel locations of the screen corresponding to the 
number and location pattern of the pixel brightness modification memory locations 
in the first projector, the luminance of the sub-image produced by the first 
projector to create a green brightness map for the first projector; 

comparing the green brightness maps of both projectors with the desired 
brightness profile; 

computing green brightness modification data for the pixel brightness 
modification memory locations by determining the difference between the green 
brightness maps and the desired brightness profile; 

supplying a full blue sub-image to each projector; 

blocking the output of the first projector and measure, at pixel locations of 
the screen corresponding to the number and location pattern of the pixel brightness 
modification memory locations in the second projector, the luminance of the sub- 
image produced by the second projector to create a blue brightness map for the 
second projector; 
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unblocking the output of the first projector^ blocking the output of the 
second projector and measure, at pixel locations of the screen corresponding to the 
number and location pattern of the pixel brightness modification memory locations 
in the first projector, the luminance of the sub-image produced by the first 
projector to create a blue brightness map for the first projector, 

comparing the blue brightness maps of both projectors with the desired 
brightness profile; and 

computing blue brightness modification data for the pixel brightness 
modification memory locations by determining the difference between the blue 
brightness maps and the desired brightness profile. 

31. The method of claim 30, wherein the alignment of the images and 
adjustment of edge blending masks is done by manual operation. 

32. The method of claim 30, wherein the alignment of the images is 
performed by the projection system. 

33. The method of claim 30, wherein the adjustment of the edge 
blending masks is performed by the projection system. 

34. The method of claim 32, wherein the alignment of the images is 
performed by the method comprising: 

projecting to the screen by the first projector a first form in the overlap 

region; 

projecting to the screen by the second projector a second form in the 
overlap region in a predefined relationship to the first form; 

imaging the first and second forms by a camera to determine the alignment 
ofthe first a nd s econd forms in order to produce an alignment output; 

analyzing the alignment output with an alignment computer to determine 
the separation ofthe first form from the second form; 
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generating control signals based on the separation of the first form from the 
second form; and 

controlling the movement of the lens of at least- the first projector by the 
control signals in order to align the first and second forms. 

35. The method of claim 32, wherein the magnification of the images is 
performed by the method comprising: 

projecting to the screen by the first projector two vertical lines in the 
overlap region; 

projecting to the screen by the second projector two horizontal lines in the 
overlap region in a predefined relationship to the vertical lines, wherein the 
vertical lines are spaced apart the same distance as the horizontal lines; 

imaging the vertical lines and the horizontal lines to determine the 
centroids for each of the lines, the distance between the vertical lines, and the 
distance between the horizontal lines; and 

if the distance between the centroids of the vertical lines does not match the 
distance between the centroids of the second set of lines, controlling a lens 
magnification adjustment mechanism on the appropriate projector to adjust the 
magnification of the projector lens until the distance between the centroids is 
matched. 

36. A projection system having at least two projectors, each projector 
producing a sub-image, wherein the sub-images are projected on a screen to form 
a composite image and edge portions of the sub-images overlap to form an overlap 
region, each projector comprising: 

a light source for producing light; 

at least one SLM device for modulating light received from the light source 
based to produce the sub-image; 

an integrator positioned between the light source and the SLM device; 

a diffiiser, positioned between the integrator and the SLM device, for 
altering the intensity distribution of the light at the output of the integrator, 
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an edge blending mask; 

an illumination relay between the diffuser and the SLM device; and 
a projection lens for projecting the sub-image. 

37. The projection system of claim 36, wherein the edge blending mask 
can be positioned between the intejgrator and the SLM device or after the SLM 
device. 

38. A projection system having at least two projectors, each projector 
producing a sub-image, wherein the sub-images are projected on a screen to form 
a composite image and edge portions of the sub-images overlap to form an overlap 
region, each projector comprising: 

a light source for producing light; 

at least one SLM device for modulating light received from the light source 
based to produce the sub-image; 

an integrator positioned between the light source and the SLM device, the 
integrator having a first section at the input of the integrator and with a cross 
section and a second section having at least two sub-integrators; 

an illumination relay between the integrator and the SLM device; 

a projection lens for projecting the sub-image; and 

an edge blending mask positioned in the optical path of the sub-image for 
gradually reducing the brightness of the projection of an edge portion of the sub- 
image. 

39. The system of claim 38, wherein the sub-integrators are separated 
by an air gap. 

40. The system of claim 38, wherein the sub-integrators are reflectively 

coated. 
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41. The system of claim 38, wherein the second section has the same 
composite cross section as the cross section of the first section. 



42. The system of claim 38, wherein the sub-integrators are tapered 
toward the outputs of the sub-integrators. 

43 . The system of claim 38, wherein the integrator is tapered toward the 
output the integrator. 

44. The system of claim 38, wherein the integrator further comprises a 
third section at the output of the integrator, so that the second section is positioned 
between the first section and the third section. 

45. The system of claim 38, wherein the cross section at the input of the 
integrator has a cross section different from the cross section at the output of the 
integrator and wherein the cross sectional area at the input is equal to the cross 
sectional area at the output. 

46. The system of claim 45, wherein the cross section of the input of the 
integrator is circular or oval and the cross section at the output of the integrator is 
rectangular. 

47. A projection system having at least two projectors, each projector 
producing a sub-image, wherein the sub-images are projected on a screen to form 
a composite image and edge portions of the sub-images overlap to form an overlap 
region, each projector comprising: 

a light source for producing light; 

at teast_one SLM device for modulating light received from the light source 
to produce the sub-image; 
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an integrator positioned between the light source and the SLM device, the 
integrator having a first section at the input of the integrator and with a cross 
section and a second section having at least two sub-integrators; 

a first edge blending mask between the integrator and the input of the 
illumination relay 

an illumination relay between the first edge blending mask and the SLM 

device; 

a second edge blending mask positioned at the output of the illumination 
relay; and 

a projection lens for projecting the sub-image, 

wherein the first edge blending mask and the second edge blending mask 
are positioned so that the effect of the first mask is balanced by the second mask to 
symmetrically clip the intensity distribution of the light passing through the 
integrator. 

48. An automatic alignment system for use in a projection system 
having at least two projectors, each projector producing a sub-image, wherein the 
sub-images are projected on a screen to form a composite image and edge portions 
of the sub-images overlap to form an overlap region, comprising: 

a camera capable of receiving the composite image from the screen; 

an alignment computer capable of analyzing the composite image and 
generating position control signals; 

a controller capable of receiving the position control signals from the 
alignment computer; 

a lens magnification adjustment mechanism associated with each projection 
lens capable of receiving position control signals from the controller and adjusting 
the magnification of the projection lens based on the position control signals; and 

a lens position adjustment mechanism associated with each projection lens 
capable of receiving position control signals from the controller and adjusting the 
position of the projection lens based on the position control signals. 
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49. The system of claim 48, wherein each projector further comprises 
an edge blending mask positioned in the optical path of the sub-image for 
gradually reducing the brightness of the projection of an edge portion of the sub- 
image and further comprising an edge blending mask position adjustment 
mechanism associated with each edge blending mask capable receiving position 
control signals from the controller and moving the position of the edge blending 
mask based on the position control signals. 

50. A method for aligning a first sub-image projected by a first 
projector having a projection lens and a second sub-image projected by a second 
projector having a projection lens; each projector having an edge blending mask to 
block the projection of an edge portion of the sub-image, the sub-images 
combined on a screen in a tiled manner so that the masked edge portions align to 
create composite image with an overlap region of the two sub-images, comprising: 

projecting to the screen by the first projector a first form in the overlap 

region; 

projecting to the screen by the second projector a second form in the 
overlap region in a predefined relationship to the first form; 

imaging the first and second forms by a camera to determine the alignment 
of the first and second forms in order to produce an alignment output; 

analyzing the alignment output with an alignment computer to determine 
the separation of the first form from the second form; 

generating control signals based on the separation of the first form from the 
second form; and 

controlling the movement of the lens of at least the first projector by the 
control signals in order to align the first arid second forms. 

51. A method for matching the magnification of a first sub-image 
projected by a first projector having a projection lens with the magnification of a 
second sub-image projected by a second projector having a projection lens; each 
projector having an edge blending mask to block the projection of an edge portion 

65 



WO 2006/014598 PCT/US20057024292 
of the sub-image, the sub-images combined on a screen in a tiled manner so that 
the masked edge portions align to create composite image with an overlap region 
of the two sub-images, comprising: 

projecting to the screen by the first projector two vertical lines in the 
overlap region; 

projecting to the screen by the second projector two horizontal lines in the 
overlap region in a predefined relationship to the vertical lines, wherein the 
vertical lines are spaced apart the same distance as the horizontal lines; 

imaging the vertical lines and the horizontal lines to determine the 
centroids for each of the lines, the distance between the vertical lines, and the 
distance between the horizontal lines; and 

if the distance between the centroids of the vertical lines does not match the 
distance between the centroids of the second set of lines, controlling a lens 
magnification adjustment mechanism on the appropriate projector to adjust the 
magnification of the projector lens until the distance between the centroids is 
matched. 
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